[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:17 dist-test-slave-xt4k krb5kdc[27032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:17 dist-test-slave-xt4k krb5kdc[27032](info): set up 2 sockets
Aug 11 00:50:17 dist-test-slave-xt4k krb5kdc[27032](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 00:50:19.156141 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.408s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:19.274987 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:43925
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:43925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:19.365264 27056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:19.365542 27056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:19.365592 27056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:19.366747 27056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:19.366784 27056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:19.366797 27056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:19.366808 27056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:19.366818 27056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:19.368544 27056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:43925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:43925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:19.368958 27056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:19.369225 27056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:19.377664 27062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.377672 27071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.377805 27064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:19.378945 27056 server_base.cc:1034] running on GCE node
I20260811 00:50:19.379294 27056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:19.379703 27056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:19.380872 27056 hybrid_clock.cc:648] HybridClock initialized: now 1786409419380847 us; error 41 us; skew 500 ppm
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:19.383556 27056 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:19.384264 27056 webserver.cc:460] Webserver started at http://127.26.99.190:43599/ using document root <none> and password file <none>
I20260811 00:50:19.384562 27056 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:19.384622 27056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:19.384815 27056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:19.386287 27056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "ce5833b9180442a49160af7648ad89f9"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "a59068bf9edc7690a698bda757180c07"
server_key_iv: "ba9b611ae4d1d7e1920e5d9fe7f76c6f"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.387015 27056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "ce5833b9180442a49160af7648ad89f9"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "a59068bf9edc7690a698bda757180c07"
server_key_iv: "ba9b611ae4d1d7e1920e5d9fe7f76c6f"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.389088 27056 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 00:50:19.390247 27081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.390573 27056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:19.390692 27056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "ce5833b9180442a49160af7648ad89f9"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "a59068bf9edc7690a698bda757180c07"
server_key_iv: "ba9b611ae4d1d7e1920e5d9fe7f76c6f"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.390808 27056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:19.402768 27056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:19.405320 27056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:19.405517 27056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:19.412803 27056 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:43925
I20260811 00:50:19.412899 27181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:43925 every 8 connection(s)
I20260811 00:50:19.413546 27056 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:19.415108 27183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:19.418767 27183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: Bootstrap starting.
I20260811 00:50:19.419782 27183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:19.420137 27183 log.cc:824] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:19.420728 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27056
I20260811 00:50:19.420841 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:19.421265 27183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: No bootstrap required, opened a new log
I20260811 00:50:19.421672 27022 external_mini_cluster.cc:1428] Setting key 8fba4295b4f65cba8cb2978d7d32262d
I20260811 00:50:19.423784 27183 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } }
I20260811 00:50:19.424018 27183 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:19.424126 27183 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5833b9180442a49160af7648ad89f9, State: Initialized, Role: FOLLOWER
I20260811 00:50:19.424314 27183 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } }
I20260811 00:50:19.424535 27183 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:19.424589 27183 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:19.424655 27183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:19.425647 27183 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } }
I20260811 00:50:19.425887 27183 leader_election.cc:302] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5833b9180442a49160af7648ad89f9; no voters:
I20260811 00:50:19.426136 27183 leader_election.cc:288] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:19.426172 27191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:19.426329 27191 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [term 1 LEADER]: Becoming Leader. State: Replica: ce5833b9180442a49160af7648ad89f9, State: Running, Role: LEADER
I20260811 00:50:19.426505 27191 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } }
I20260811 00:50:19.426800 27183 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:19.427181 27191 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5833b9180442a49160af7648ad89f9. Latest consensus state: current_term: 1 leader_uuid: "ce5833b9180442a49160af7648ad89f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } } }
I20260811 00:50:19.427675 27191 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:19.427572 27193 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5833b9180442a49160af7648ad89f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5833b9180442a49160af7648ad89f9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43925 } } }
I20260811 00:50:19.428211 27193 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9 [sys.catalog]: This master's current role is: LEADER
W20260811 00:50:19.430104 27219 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:19.430155 27219 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:19.430282 27203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:19.430711 27203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:19.433128 27203 catalog_manager.cc:1347] Generated new cluster ID: c42e25d078164673bd67bf04ba50a4f1
I20260811 00:50:19.433183 27203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:19.440835 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:19.423239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47364 (local address 127.26.99.190:43925)
0811 00:50:19.423544 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:19.423555 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:19.423796 (+ 241us) server_negotiation.cc:407] Connection header received
0811 00:50:19.426042 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:19.426049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:19.426147 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:19.426279 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:19.428881 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.430185 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.431781 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.432197 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.432298 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:19.436561 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:19.436564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:19.436564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:19.436575 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:19.438389 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.438890 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.438893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.438893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.439005 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.439282 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.439282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.439282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.439562 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:19.440325 (+ 763us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:19.440434 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 00:50:19.440608 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":88,"threads_started":1}
I20260811 00:50:19.470284 27203 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:19.471103 27203 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:19.484735 27203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5833b9180442a49160af7648ad89f9: Generated new TSK 0
I20260811 00:50:19.484953 27203 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:19.522447 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:19.647418 27226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:19.647702 27226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:19.647737 27226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:19.649511 27226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:19.649571 27226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:19.649611 27226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:19.651813 27226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:19.652179 27226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:19.652508 27226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:19.658610 27237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.658599 27243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.658599 27238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:19.658888 27226 server_base.cc:1034] running on GCE node
I20260811 00:50:19.659076 27226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:19.659304 27226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:19.660420 27226 hybrid_clock.cc:648] HybridClock initialized: now 1786409419660400 us; error 33 us; skew 500 ppm
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:19.662966 27226 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:19.663524 27226 webserver.cc:460] Webserver started at http://127.26.99.129:36299/ using document root <none> and password file <none>
I20260811 00:50:19.663735 27226 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:19.663780 27226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:19.663892 27226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:19.665071 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "01534d5293094116b4b05201df27ee60"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "95d051d434b0e3c2d539e9cf7370e682"
server_key_iv: "e05395deead2e441786283327bd34427"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.665480 27226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "01534d5293094116b4b05201df27ee60"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "95d051d434b0e3c2d539e9cf7370e682"
server_key_iv: "e05395deead2e441786283327bd34427"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.666888 27226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:19.667505 27253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.667641 27226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:19.667728 27226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "01534d5293094116b4b05201df27ee60"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "95d051d434b0e3c2d539e9cf7370e682"
server_key_iv: "e05395deead2e441786283327bd34427"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.667784 27226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:19.691692 27226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:19.693550 27226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:19.693691 27226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:19.694000 27226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:19.694401 27226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:19.694495 27226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.694540 27226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:19.694566 27226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.703464 27226 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36361
I20260811 00:50:19.703504 27437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36361 every 8 connection(s)
I20260811 00:50:19.703811 27226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:19.708797 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27226
I20260811 00:50:19.708881 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:19.709038 27022 external_mini_cluster.cc:1428] Setting key bffa7bfe1e9ac9e8ff13c3e5595acca8
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:19.713106 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:19.704830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:41021 (local address 127.26.99.190:43925)
0811 00:50:19.704889 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:19.704891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:19.705110 (+ 219us) server_negotiation.cc:407] Connection header received
0811 00:50:19.705619 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:19.705620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:19.705630 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:19.705691 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:19.706676 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.707178 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.708088 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.708268 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.708310 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:19.710548 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:19.710549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:19.710550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:19.710556 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:19.711763 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.712148 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.712149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.712149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.712204 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.712478 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.712479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.712479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.712619 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:19.712683 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:19.712931 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 00:50:19.713024 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:50:19.713203 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:19.704794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43925 (local address 127.26.99.129:41021)
0811 00:50:19.705006 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:19.705042 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:19.705538 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:19.705762 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:19.705765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:19.706389 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:19.706601 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:19.706607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.707238 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.707239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:19.708027 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:19.708030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.708321 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.708321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:19.708473 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:19.708961 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:19.708971 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:19.710454 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:19.711835 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:19.711855 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:19.711857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:19.712079 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:19.712261 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:19.712262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:19.712262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:19.712408 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:19.712678 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:19.712685 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:19.712806 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 00:50:19.712894 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:50:19.713021 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":132,"threads_started":1}
I20260811 00:50:19.713709 27438 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43925
I20260811 00:50:19.713800 27438 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:19.713975 27438 heartbeater.cc:511] Master 127.26.99.190:43925 requested a full tablet report, sending...
I20260811 00:50:19.715088 27114 ts_manager.cc:194] Registered new tserver with Master: 01534d5293094116b4b05201df27ee60 (127.26.99.129:36361)
I20260811 00:50:19.716187 27114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:41021
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:19.733295 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:19.815194 27445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:19.815388 27445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:19.815419 27445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:19.816552 27445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:19.816592 27445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:19.816628 27445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:19.818051 27445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:19.818279 27445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:19.818472 27445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:19.823336 27451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.823382 27456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.823339 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:19.823439 27445 server_base.cc:1034] running on GCE node
I20260811 00:50:19.823727 27445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:19.823951 27445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:19.825114 27445 hybrid_clock.cc:648] HybridClock initialized: now 1786409419825093 us; error 37 us; skew 500 ppm
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:19.827556 27445 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:19.827984 27445 webserver.cc:460] Webserver started at http://127.26.99.130:33991/ using document root <none> and password file <none>
I20260811 00:50:19.828204 27445 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:19.828248 27445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:19.828361 27445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:19.829454 27445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "1a318db01e60453e8e4281f766e61ad2"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "b071614cb26acf5ae57755ba3e7f24ea"
server_key_iv: "9ab8361349c9fb41bdb4be8e3dd77092"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.829749 27445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "1a318db01e60453e8e4281f766e61ad2"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "b071614cb26acf5ae57755ba3e7f24ea"
server_key_iv: "9ab8361349c9fb41bdb4be8e3dd77092"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.831104 27445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:19.831730 27470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.831874 27445 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:19.831952 27445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "1a318db01e60453e8e4281f766e61ad2"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "b071614cb26acf5ae57755ba3e7f24ea"
server_key_iv: "9ab8361349c9fb41bdb4be8e3dd77092"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.832017 27445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:19.850309 27445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:19.852283 27445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:19.852451 27445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:19.852672 27445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:19.852979 27445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:19.853022 27445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.853044 27445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:19.853055 27445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:19.860563 27445 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:45651
I20260811 00:50:19.860626 27662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:45651 every 8 connection(s)
I20260811 00:50:19.860939 27445 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:19.867918 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27445
I20260811 00:50:19.868012 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:19.868185 27022 external_mini_cluster.cc:1428] Setting key 9a5b4b669840e570cf5d7f9014550ec0
I20260811 00:50:19.869750 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:19.861661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:32807 (local address 127.26.99.190:43925)
0811 00:50:19.861720 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:19.861722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:19.861927 (+ 205us) server_negotiation.cc:407] Connection header received
0811 00:50:19.862443 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:19.862444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:19.862454 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:19.862520 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:19.863405 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.863912 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.864904 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.865090 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.865133 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:19.867134 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:19.867135 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:19.867135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:19.867142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:19.868385 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.868871 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.868872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.868873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.868936 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:19.869165 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:19.869166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:19.869166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:19.869293 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:19.869360 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:19.869577 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 00:50:19.869662 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:50:19.869812 27668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:19.861610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43925 (local address 127.26.99.130:32807)
0811 00:50:19.861802 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:19.861844 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:19.862342 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:19.862577 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:19.862580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:19.863140 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:19.863335 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:19.863340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.863978 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.863978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:19.864835 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:19.864838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:19.865142 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:19.865142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:19.865248 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:19.865653 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:19.865660 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:19.867041 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:19.868458 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:19.868465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:19.868467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:19.868799 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:19.868999 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:19.869000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:19.869000 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:19.869105 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:19.869351 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:19.869353 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:19.869462 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 00:50:19.869538 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:50:19.869655 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":106,"threads_started":1}
I20260811 00:50:19.871703 27664 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43925
I20260811 00:50:19.871805 27664 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:19.871989 27664 heartbeater.cc:511] Master 127.26.99.190:43925 requested a full tablet report, sending...
I20260811 00:50:19.872355 27114 ts_manager.cc:194] Registered new tserver with Master: 1a318db01e60453e8e4281f766e61ad2 (127.26.99.130:45651)
I20260811 00:50:19.872815 27114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:32807
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:19.893404 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:19.982229 27673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:19.982451 27673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:19.982477 27673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:19.983634 27673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:19.983675 27673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:19.983701 27673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:19.985217 27673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43925
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:19.985426 27673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:19.985622 27673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:19.990731 27682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.990741 27683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:19.990741 27685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:19.990805 27673 server_base.cc:1034] running on GCE node
I20260811 00:50:19.991071 27673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:19.991274 27673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:19.992425 27673 hybrid_clock.cc:648] HybridClock initialized: now 1786409419992409 us; error 31 us; skew 500 ppm
Aug 11 00:50:19 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:19.995025 27673 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:19.995549 27673 webserver.cc:460] Webserver started at http://127.26.99.131:39717/ using document root <none> and password file <none>
I20260811 00:50:19.995793 27673 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:19.995841 27673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:19.995946 27673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:19.997458 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "80759748b4334e03be7c11b9be6f0f6b"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "9c33b739c8efa43581cad015b60d2e51"
server_key_iv: "24b576d85606e519c13ec595f810ae13"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.997792 27673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "80759748b4334e03be7c11b9be6f0f6b"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "9c33b739c8efa43581cad015b60d2e51"
server_key_iv: "24b576d85606e519c13ec595f810ae13"
server_key_version: "encryptionkey@0"
I20260811 00:50:19.999467 27673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:20.000237 27701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:20.000422 27673 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:20.000512 27673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "80759748b4334e03be7c11b9be6f0f6b"
format_stamp: "Formatted at 2026-08-11 00:50:19 on dist-test-slave-xt4k"
server_key: "9c33b739c8efa43581cad015b60d2e51"
server_key_iv: "24b576d85606e519c13ec595f810ae13"
server_key_version: "encryptionkey@0"
I20260811 00:50:20.000579 27673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:20.010906 27673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:20.012989 27673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:20.013135 27673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:20.013347 27673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:20.013662 27673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:20.013697 27673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:20.013726 27673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:20.013751 27673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:20.024475 27673 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:36907
I20260811 00:50:20.024539 27904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:36907 every 8 connection(s)
I20260811 00:50:20.024845 27673 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:20.029393 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27673
I20260811 00:50:20.029472 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:20.029605 27022 external_mini_cluster.cc:1428] Setting key b6199d13e2c58e1fabe0fa3f9c27047b
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409419, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:20.034885 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:20.025626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:59605 (local address 127.26.99.190:43925)
0811 00:50:20.025703 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:20.025705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:20.025957 (+ 252us) server_negotiation.cc:407] Connection header received
0811 00:50:20.026552 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:20.026554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:20.026565 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:20.026617 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:20.027566 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.028114 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.029278 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.029485 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.029552 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:20.031954 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:20.031955 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:20.031956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:20.031963 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:20.033490 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.033889 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.033890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.033891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.033946 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.034170 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.034171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.034171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.034290 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:20.034348 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:20.034703 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 00:50:20.034793 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:50:20.035095 27911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:20.025601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43925 (local address 127.26.99.131:59605)
0811 00:50:20.025841 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:20.025877 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:20.026439 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:20.026678 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:20.026681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:20.027246 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:20.027479 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:20.027485 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.028198 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.028199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:20.029181 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:20.029183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.029602 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.029603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:20.029748 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:20.030335 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:20.030346 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:20.031866 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:20.033582 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:20.033590 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:20.033592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:20.033822 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:20.034002 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:20.034002 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:20.034003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:20.034113 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:20.034345 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:20.034352 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:20.034492 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:50:20.034685 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 00:50:20.034858 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":156,"threads_started":1}
I20260811 00:50:20.035544 27907 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43925
I20260811 00:50:20.035641 27907 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:20.035820 27907 heartbeater.cc:511] Master 127.26.99.190:43925 requested a full tablet report, sending...
I20260811 00:50:20.036213 27114 ts_manager.cc:194] Registered new tserver with Master: 80759748b4334e03be7c11b9be6f0f6b (127.26.99.131:36907)
I20260811 00:50:20.036715 27114 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:59605
I20260811 00:50:20.041808 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:20.069432 27916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:20.061796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45924 (local address 127.26.99.129:36361)
0811 00:50:20.061959 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:20.061964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:20.061975 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:20.062004 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:20.062006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:20.062021 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:20.062096 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:20.062708 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.063457 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.064165 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.064559 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.064617 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:20.066916 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:20.066925 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:20.066925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:20.066932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:20.068288 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.068641 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.068644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.068644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.068704 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.068924 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.068925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.068925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.069063 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:20.069189 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:20.069282 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 00:50:20.069350 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
W20260811 00:50:20.069900 27298 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45924
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:20.096794 27916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:20.089670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45936 (local address 127.26.99.129:36361)
0811 00:50:20.089743 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:20.089745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:20.089759 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:50:20.089834 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:20.089835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:20.089848 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:20.089897 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:20.090447 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.090960 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.091690 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:20.091898 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:20.091956 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:20.094484 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:20.094485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:20.094486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:20.094493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:20.095675 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.096026 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.096028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.096028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.096084 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:20.096251 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:20.096252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:20.096252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:20.096393 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:20.096506 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:20.096605 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 00:50:20.096692 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:50:20.097544 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27226
I20260811 00:50:20.119876 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27445
I20260811 00:50:20.129240 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27673
I20260811 00:50:20.143528 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27056
2026-08-11T00:50:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2429 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27928](info): set up 2 sockets
Aug 11 00:50:20 dist-test-slave-xt4k krb5kdc[27928](info): commencing operation
krb5kdc: starting...
W20260811 00:50:21.374943 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 00:50:21.526445 27022 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.151s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 00:50:21.660040 27022 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.133s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 00:50:21.775219 27022 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.115s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/test-user.keytab.
W20260811 00:50:22.365249 27022 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.590s user 0.000s sys 0.002s
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
W20260811 00:50:22.548393 27022 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.26.99.190: real 0.162s user 0.000s sys 0.003s
I20260811 00:50:22.548821 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:45701
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:45701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:22.630892 27957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:22.631098 27957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:22.631131 27957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:22.632251 27957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:22.632290 27957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:22.632309 27957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:22.632326 27957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:22.632370 27957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:22.633831 27957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:45701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:45701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:22.634068 27957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:22.634290 27957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:22.638926 27972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:22.638947 27967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:22.638926 27966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:22.639176 27957 server_base.cc:1034] running on GCE node
I20260811 00:50:22.639413 27957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:22.639684 27957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:22.640832 27957 hybrid_clock.cc:648] HybridClock initialized: now 1786409422640816 us; error 29 us; skew 500 ppm
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:22.646293 27957 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:22.646705 27957 webserver.cc:460] Webserver started at http://127.26.99.190:38145/ using document root <none> and password file <none>
I20260811 00:50:22.646922 27957 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:22.646971 27957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:22.647101 27957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:22.648162 27957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "24193463998f4551a8390af49d606410"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "94a6355f14629e8ebed767c81d9fe684"
server_key_iv: "9ae3cf5d7726c63c977e55f71e964067"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.648584 27957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "24193463998f4551a8390af49d606410"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "94a6355f14629e8ebed767c81d9fe684"
server_key_iv: "9ae3cf5d7726c63c977e55f71e964067"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.649946 27957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:22.650650 27983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:22.650800 27957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:22.650876 27957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "24193463998f4551a8390af49d606410"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "94a6355f14629e8ebed767c81d9fe684"
server_key_iv: "9ae3cf5d7726c63c977e55f71e964067"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.650938 27957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:22.666558 27957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:22.668411 27957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:22.668558 27957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:22.672212 27957 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:45701
I20260811 00:50:22.672260 28074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:45701 every 8 connection(s)
I20260811 00:50:22.672598 27957 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:22.673451 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:22.673918 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27957
I20260811 00:50:22.674005 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:22.674153 27022 external_mini_cluster.cc:1428] Setting key be8c1f753e48b4a494fd4de237b5ccae
I20260811 00:50:22.676278 28075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410: Bootstrap starting.
I20260811 00:50:22.676862 28075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:22.677134 28075 log.cc:824] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:22.677839 28075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410: No bootstrap required, opened a new log
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:22.680153 28075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } }
I20260811 00:50:22.680317 28075 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:22.680384 28075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24193463998f4551a8390af49d606410, State: Initialized, Role: FOLLOWER
I20260811 00:50:22.680500 28075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } }
I20260811 00:50:22.680580 28075 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:22.680605 28075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:22.680650 28075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:22.681311 28075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } }
I20260811 00:50:22.681427 28075 leader_election.cc:302] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24193463998f4551a8390af49d606410; no voters:
I20260811 00:50:22.681592 28075 leader_election.cc:288] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:22.681644 28084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:22.681789 28084 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [term 1 LEADER]: Becoming Leader. State: Replica: 24193463998f4551a8390af49d606410, State: Running, Role: LEADER
I20260811 00:50:22.681850 28075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:22.681905 28084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } }
I20260811 00:50:22.682224 28084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24193463998f4551a8390af49d606410. Latest consensus state: current_term: 1 leader_uuid: "24193463998f4551a8390af49d606410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } } }
I20260811 00:50:22.682300 28084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:22.682461 28085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24193463998f4551a8390af49d606410" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24193463998f4551a8390af49d606410" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45701 } } }
I20260811 00:50:22.682525 28085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:22.682636 28099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:22.683343 28099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:22.684540 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:22.674713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33458 (local address 127.26.99.190:45701)
0811 00:50:22.674862 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:22.674870 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:22.674895 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:50:22.675302 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:22.675308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:22.675354 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:22.675466 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:22.676183 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.677148 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.677869 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.678314 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.678410 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:22.680826 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:22.680830 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:22.680831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:22.680843 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:22.682796 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:22.683228 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:22.683231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:22.683231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:22.683333 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:22.683601 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:22.683602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:22.683602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:22.683899 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:22.684054 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:22.684179 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:50:22.684314 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260811 00:50:22.685271 28099 catalog_manager.cc:1347] Generated new cluster ID: 69a5c2a8bdac462d86c47d958a6f096a
I20260811 00:50:22.685326 28099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:22.699951 28099 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:22.700752 28099 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:22.705752 28099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24193463998f4551a8390af49d606410: Generated new TSK 0
I20260811 00:50:22.705929 28099 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:22.731741 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:22.816906 28125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:22.817112 28125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:22.817135 28125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:22.818249 28125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:22.818280 28125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:22.818305 28125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:22.819773 28125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:22.819965 28125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:22.820143 28125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:22.825079 28142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:22.825115 28145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:22.825083 28139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:22.825412 28125 server_base.cc:1034] running on GCE node
I20260811 00:50:22.825603 28125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:22.825806 28125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:22.826948 28125 hybrid_clock.cc:648] HybridClock initialized: now 1786409422826933 us; error 28 us; skew 500 ppm
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:22.829484 28125 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:22.829963 28125 webserver.cc:460] Webserver started at http://127.26.99.129:46333/ using document root <none> and password file <none>
I20260811 00:50:22.830180 28125 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:22.830225 28125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:22.830350 28125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:22.831377 28125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "c02671649d574292b8010ffe90af4744"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "fdaf887472fa407b59b8ad3995fd9874"
server_key_iv: "74ebdb082f9626ca3aeb0e99bf39f391"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.831755 28125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "c02671649d574292b8010ffe90af4744"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "fdaf887472fa407b59b8ad3995fd9874"
server_key_iv: "74ebdb082f9626ca3aeb0e99bf39f391"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.833115 28125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:50:22.833801 28154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:22.833943 28125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:22.834035 28125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "c02671649d574292b8010ffe90af4744"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "fdaf887472fa407b59b8ad3995fd9874"
server_key_iv: "74ebdb082f9626ca3aeb0e99bf39f391"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.834097 28125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:22.850870 28125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:22.852957 28125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:22.853101 28125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:22.853302 28125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:22.853606 28125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:22.853650 28125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:22.853685 28125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:22.853709 28125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:22.859508 28125 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:34129
I20260811 00:50:22.859555 28350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:34129 every 8 connection(s)
I20260811 00:50:22.859858 28125 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:22.866837 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28125
I20260811 00:50:22.866914 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:22.867065 27022 external_mini_cluster.cc:1428] Setting key d785a25e58d06a5173928713bfd7b25e
I20260811 00:50:22.869071 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:22.860615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:46657 (local address 127.26.99.190:45701)
0811 00:50:22.860674 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:22.860676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:22.860868 (+ 192us) server_negotiation.cc:407] Connection header received
0811 00:50:22.861947 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:22.861948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:22.861961 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:22.862027 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:22.862683 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.863204 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.864197 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.864437 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.864492 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:22.866468 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:22.866470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:22.866470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:22.866479 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:22.867787 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:22.868202 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:22.868203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:22.868203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:22.868252 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:22.868507 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:22.868508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:22.868508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:22.868611 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:22.868665 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:22.868942 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 00:50:22.869007 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:22.869298 28355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:22.860565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45701 (local address 127.26.99.129:46657)
0811 00:50:22.860747 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:22.860786 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:22.861833 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:22.862105 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:22.862110 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:22.862369 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:22.862585 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:22.862589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.863292 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.863293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:22.864107 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:22.864110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:22.864526 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:22.864527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:22.864648 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:22.865068 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:22.865076 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:22.866380 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:22.867861 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:22.867870 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:22.867872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:22.868129 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:22.868299 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:22.868300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:22.868300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:22.868452 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:22.868667 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:22.868672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:22.868823 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 00:50:22.868930 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 00:50:22.869084 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260811 00:50:22.869988 28351 heartbeater.cc:347] Connected to a master server at 127.26.99.190:45701
I20260811 00:50:22.870085 28351 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:22.870260 28351 heartbeater.cc:511] Master 127.26.99.190:45701 requested a full tablet report, sending...
I20260811 00:50:22.870808 28010 ts_manager.cc:194] Registered new tserver with Master: c02671649d574292b8010ffe90af4744 (127.26.99.129:34129)
I20260811 00:50:22.871403 28010 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:46657
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:22.892180 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:22.976331 28361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:22.976588 28361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:22.976610 28361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:22.977754 28361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:22.977794 28361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:22.977820 28361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:22.979315 28361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:22.979539 28361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:22.979745 28361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:22.984877 28368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:22.985088 28370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:22.985255 28361 server_base.cc:1034] running on GCE node
W20260811 00:50:22.985364 28367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:22.985581 28361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:22.985817 28361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:22.986968 28361 hybrid_clock.cc:648] HybridClock initialized: now 1786409422986953 us; error 33 us; skew 500 ppm
Aug 11 00:50:22 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:22.989688 28361 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:22.990219 28361 webserver.cc:460] Webserver started at http://127.26.99.130:36723/ using document root <none> and password file <none>
I20260811 00:50:22.990443 28361 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:22.990494 28361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:22.990630 28361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:22.991673 28361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "e225ba5f89c341b58b098ff197299c85"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "172e439df8b446522504c842e4af5937"
server_key_iv: "15d55f44edffecb466a5b68147019b34"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.992008 28361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "e225ba5f89c341b58b098ff197299c85"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "172e439df8b446522504c842e4af5937"
server_key_iv: "15d55f44edffecb466a5b68147019b34"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.993424 28361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:22.994187 28386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:22.994359 28361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:22.994454 28361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "e225ba5f89c341b58b098ff197299c85"
format_stamp: "Formatted at 2026-08-11 00:50:22 on dist-test-slave-xt4k"
server_key: "172e439df8b446522504c842e4af5937"
server_key_iv: "15d55f44edffecb466a5b68147019b34"
server_key_version: "encryptionkey@0"
I20260811 00:50:22.994535 28361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:23.006855 28361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:23.008823 28361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:23.008970 28361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:23.009214 28361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:23.009526 28361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:23.009562 28361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:23.009591 28361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:23.009609 28361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:23.015550 28361 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:45831
I20260811 00:50:23.015622 28588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:45831 every 8 connection(s)
I20260811 00:50:23.016068 28361 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:23.017102 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28361
I20260811 00:50:23.017192 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:23.017354 27022 external_mini_cluster.cc:1428] Setting key 3d0469b7d29e6c780f2ee268ce85731d
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
I20260811 00:50:23.026856 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.016911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:44057 (local address 127.26.99.190:45701)
0811 00:50:23.017039 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.017042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.017135 (+ 93us) server_negotiation.cc:407] Connection header received
0811 00:50:23.018220 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.018221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.018233 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.018294 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.018920 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.019601 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.021098 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.021311 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.021367 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.023896 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.023897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.023898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.023905 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.025297 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.025795 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.025796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.025797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.025861 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.026155 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.026156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.026157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.026286 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.026360 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.026676 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.026764 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 00:50:23.027031 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.016831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45701 (local address 127.26.99.130:44057)
0811 00:50:23.017004 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.017046 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.018121 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.018357 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.018360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.018625 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:23.018823 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.018828 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.019723 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.019724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.021000 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.021004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.021395 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.021396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.021544 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.022069 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:23.022081 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:23.023774 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:23.025379 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:23.025387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:23.025390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:23.025700 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:23.025932 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:23.025933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:23.025934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:23.026073 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:23.026375 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:23.026401 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:23.026541 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.026639 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.026808 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260811 00:50:23.027516 28590 heartbeater.cc:347] Connected to a master server at 127.26.99.190:45701
I20260811 00:50:23.027617 28590 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:23.027813 28590 heartbeater.cc:511] Master 127.26.99.190:45701 requested a full tablet report, sending...
I20260811 00:50:23.028230 28010 ts_manager.cc:194] Registered new tserver with Master: e225ba5f89c341b58b098ff197299c85 (127.26.99.130:45831)
I20260811 00:50:23.028627 28010 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:44057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:23.044502 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:23.125697 28599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:23.125914 28599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:23.125948 28599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:23.127079 28599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:23.127118 28599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:23.127154 28599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:23.128674 28599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:45701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:23.128909 28599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:23.129117 28599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:23.134124 28613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:23.134120 28620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:23.134299 28599 server_base.cc:1034] running on GCE node
W20260811 00:50:23.134146 28614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:23.134584 28599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:23.134847 28599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:23.135982 28599 hybrid_clock.cc:648] HybridClock initialized: now 1786409423135970 us; error 33 us; skew 500 ppm
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:23.138429 28599 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:23.138864 28599 webserver.cc:460] Webserver started at http://127.26.99.131:39269/ using document root <none> and password file <none>
I20260811 00:50:23.139048 28599 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:23.139087 28599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:23.139197 28599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:23.140216 28599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "5833e1621e594cc28573db6735eece81"
format_stamp: "Formatted at 2026-08-11 00:50:23 on dist-test-slave-xt4k"
server_key: "fe58ded36de3da3ab65f911cf8e9d0c1"
server_key_iv: "40377dc935490eea915a42c343288379"
server_key_version: "encryptionkey@0"
I20260811 00:50:23.140574 28599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "5833e1621e594cc28573db6735eece81"
format_stamp: "Formatted at 2026-08-11 00:50:23 on dist-test-slave-xt4k"
server_key: "fe58ded36de3da3ab65f911cf8e9d0c1"
server_key_iv: "40377dc935490eea915a42c343288379"
server_key_version: "encryptionkey@0"
I20260811 00:50:23.141925 28599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:23.142674 28633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:23.142834 28599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:23.142921 28599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "5833e1621e594cc28573db6735eece81"
format_stamp: "Formatted at 2026-08-11 00:50:23 on dist-test-slave-xt4k"
server_key: "fe58ded36de3da3ab65f911cf8e9d0c1"
server_key_iv: "40377dc935490eea915a42c343288379"
server_key_version: "encryptionkey@0"
I20260811 00:50:23.142977 28599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:23.173578 28599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:23.175560 28599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:23.175691 28599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:23.175889 28599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:23.176198 28599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:23.176232 28599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:23.176254 28599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:23.176278 28599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:23.182721 28599 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:35511
I20260811 00:50:23.182809 28833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:35511 every 8 connection(s)
I20260811 00:50:23.183145 28599 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:23.190053 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28599
I20260811 00:50:23.190142 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:23.190285 27022 external_mini_cluster.cc:1428] Setting key d472f4f947c9f0109c75bb36d2c3faeb
I20260811 00:50:23.193013 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.184145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:40629 (local address 127.26.99.190:45701)
0811 00:50:23.184232 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.184234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.184533 (+ 299us) server_negotiation.cc:407] Connection header received
0811 00:50:23.185659 (+ 1126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.185660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.185672 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.185738 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.186447 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.186985 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.188038 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.188243 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.188295 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.190536 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.190538 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.190539 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.190546 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.191797 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.192169 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.192170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.192170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.192216 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.192449 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.192450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.192450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.192551 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.192600 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.192886 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.192949 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 00:50:23.193209 28837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.184147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45701 (local address 127.26.99.131:40629)
0811 00:50:23.184373 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.184429 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.185488 (+ 1059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.185855 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.185859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.186142 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:23.186359 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.186364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.187066 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.187067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.187959 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.187961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.188306 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.188306 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.188456 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.188947 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:23.188955 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:23.190434 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:23.191869 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:23.191875 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:23.191877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:23.192112 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:23.192260 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:23.192261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:23.192261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:23.192394 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:23.192627 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:23.192634 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:23.192770 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.192861 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.193005 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":125,"threads_started":1}
I20260811 00:50:23.193662 28835 heartbeater.cc:347] Connected to a master server at 127.26.99.190:45701
I20260811 00:50:23.193759 28835 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:23.193935 28835 heartbeater.cc:511] Master 127.26.99.190:45701 requested a full tablet report, sending...
I20260811 00:50:23.194305 28010 ts_manager.cc:194] Registered new tserver with Master: 5833e1621e594cc28573db6735eece81 (127.26.99.131:35511)
I20260811 00:50:23.194679 28010 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:40629
I20260811 00:50:23.202396 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:23.209723 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.204376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33474 (local address 127.26.99.190:45701)
0811 00:50:23.204420 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.204421 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.204491 (+ 70us) server_negotiation.cc:407] Connection header received
0811 00:50:23.204542 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.204542 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.204550 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.204599 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.205091 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.205609 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.206362 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.206550 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.206603 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.207607 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.207608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.207608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.207615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.208863 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.209154 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.209155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.209155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.209200 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.209320 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.209321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.209321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.209446 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.209515 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.209588 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.209662 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:23.212230 28010 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:23.214082 28010 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:23.221057 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:45831 (local address 127.0.0.1:57148)
0811 00:50:23.217342 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.217385 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.217449 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.217681 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.217684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.217686 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:23.217758 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.217760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.218826 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.218827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.219833 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.219836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.220767 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.220768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.220843 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.220857 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.220930 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.220982 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":49,"threads_started":1}
I20260811 00:50:23.221066 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57148 (local address 127.26.99.130:45831)
0811 00:50:23.217491 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.217496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.217507 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:23.217556 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.217558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.217574 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.217640 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:23.217822 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.218722 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.219925 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.220689 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.220762 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.220819 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.220947 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.220986 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":73,"threads_started":1}
I20260811 00:50:23.221473 28854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:34129 (local address 127.0.0.1:41576)
0811 00:50:23.217684 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.217691 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.217738 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.217879 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.217879 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.217881 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:23.217985 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.217987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.219387 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.219388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.220403 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.220406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.221229 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.221230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.221315 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.221320 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.221370 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.221409 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":89,"threads_started":1}
I20260811 00:50:23.221503 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41576 (local address 127.26.99.129:34129)
0811 00:50:23.217583 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.217589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.217752 (+ 163us) server_negotiation.cc:407] Connection header received
0811 00:50:23.217792 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.217794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.217808 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.217884 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:23.218116 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.219242 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.220488 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.221137 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.221203 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.221263 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.221388 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.221430 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":83,"threads_started":1}
I20260811 00:50:23.222004 28474 tablet_service.cc:1467] Processing CreateTablet for tablet 91392f06ce334560881cf55d4bb2203a (DEFAULT_TABLE table=test-table [id=f9c8d27669e94c9fa7a67a466ee080cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:23.222146 28855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:35511 (local address 127.0.0.1:42454)
0811 00:50:23.217569 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.217579 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.217616 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.218026 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.218027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.218030 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:23.218097 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.218098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.219358 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.219359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.220469 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.220473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.221900 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.221901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.221974 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.221978 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.222034 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.222083 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":35,"spinlock_wait_cycles":896,"thread_start_us":175,"threads_started":1}
I20260811 00:50:23.222164 28232 tablet_service.cc:1467] Processing CreateTablet for tablet 91392f06ce334560881cf55d4bb2203a (DEFAULT_TABLE table=test-table [id=f9c8d27669e94c9fa7a67a466ee080cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:23.222421 28474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91392f06ce334560881cf55d4bb2203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:23.222466 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.217281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42454 (local address 127.26.99.131:35511)
0811 00:50:23.217844 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.217847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.217856 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:23.217893 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.217895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.217912 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.218019 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:23.218163 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.219253 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.220540 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.221826 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.221898 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.221950 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.222050 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.222094 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":81,"threads_started":1}
I20260811 00:50:23.222534 28232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91392f06ce334560881cf55d4bb2203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:23.223044 28711 tablet_service.cc:1467] Processing CreateTablet for tablet 91392f06ce334560881cf55d4bb2203a (DEFAULT_TABLE table=test-table [id=f9c8d27669e94c9fa7a67a466ee080cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:23.223380 28711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91392f06ce334560881cf55d4bb2203a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:23.225600 28863 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Bootstrap starting.
I20260811 00:50:23.225886 28870 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Bootstrap starting.
I20260811 00:50:23.226532 28863 tablet_bootstrap.cc:654] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:23.226562 28870 tablet_bootstrap.cc:654] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:23.226575 28873 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Bootstrap starting.
I20260811 00:50:23.227205 28873 tablet_bootstrap.cc:654] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:23.227288 28870 log.cc:824] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:23.227770 28873 log.cc:824] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:23.228142 28870 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: No bootstrap required, opened a new log
I20260811 00:50:23.228199 28870 ts_tablet_manager.cc:1397] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:23.228513 28873 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: No bootstrap required, opened a new log
I20260811 00:50:23.228575 28873 ts_tablet_manager.cc:1397] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:23.229518 28863 log.cc:824] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:23.230100 28870 raft_consensus.cc:348] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.230304 28870 raft_consensus.cc:374] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:23.230332 28863 tablet_bootstrap.cc:492] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: No bootstrap required, opened a new log
I20260811 00:50:23.230358 28870 raft_consensus.cc:729] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c02671649d574292b8010ffe90af4744, State: Initialized, Role: FOLLOWER
I20260811 00:50:23.230386 28863 ts_tablet_manager.cc:1397] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 00:50:23.230504 28870 consensus_queue.cc:260] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.230428 28873 raft_consensus.cc:348] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.230646 28873 raft_consensus.cc:374] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:23.230685 28873 raft_consensus.cc:729] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5833e1621e594cc28573db6735eece81, State: Initialized, Role: FOLLOWER
I20260811 00:50:23.230803 28870 ts_tablet_manager.cc:1428] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:23.230796 28873 consensus_queue.cc:260] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.230990 28351 heartbeater.cc:503] Master 127.26.99.190:45701 was elected leader, sending a full tablet report...
I20260811 00:50:23.231048 28873 ts_tablet_manager.cc:1428] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:50:23.231156 28835 heartbeater.cc:503] Master 127.26.99.190:45701 was elected leader, sending a full tablet report...
I20260811 00:50:23.232205 28863 raft_consensus.cc:348] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.232357 28863 raft_consensus.cc:374] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:23.232400 28863 raft_consensus.cc:729] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e225ba5f89c341b58b098ff197299c85, State: Initialized, Role: FOLLOWER
I20260811 00:50:23.232506 28863 consensus_queue.cc:260] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.232797 28863 ts_tablet_manager.cc:1428] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:50:23.232877 28590 heartbeater.cc:503] Master 127.26.99.190:45701 was elected leader, sending a full tablet report...
W20260811 00:50:23.266732 28591 tablet.cc:2369] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:23.360621 28353 tablet.cc:2369] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:23.433823 28836 tablet.cc:2369] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:23.457806 28883 raft_consensus.cc:482] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:23.457968 28883 raft_consensus.cc:504] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.458590 28883 leader_election.cc:288] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e225ba5f89c341b58b098ff197299c85 (127.26.99.130:45831), c02671649d574292b8010ffe90af4744 (127.26.99.129:34129)
I20260811 00:50:23.461342 28837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.458804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:45831 (local address 127.26.99.131:52067)
0811 00:50:23.458856 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.458868 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.458935 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.459088 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.459089 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.459090 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:23.459174 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.459176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.459786 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.459787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.460571 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.460573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.461112 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.461113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.461180 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.461183 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.461229 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.461268 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:50:23.461342 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.458868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:52067 (local address 127.26.99.130:45831)
0811 00:50:23.458923 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.458925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.458935 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:23.459020 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.459021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.459029 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.459074 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:23.459237 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.459712 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.460652 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.461038 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.461101 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.461111 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.461244 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.461280 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:50:23.461516 28885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.458805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:34129 (local address 127.26.99.131:60075)
0811 00:50:23.459051 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:23.459059 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:23.459120 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:23.459241 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:23.459241 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:23.459243 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:23.459319 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.459321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.459927 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.459928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.460719 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:23.460722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.461231 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.461232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:23.461347 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.461350 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:23.461398 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:50:23.461437 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":55,"thread_start_us":123,"threads_started":1}
I20260811 00:50:23.461519 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.458891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:60075 (local address 127.26.99.129:34129)
0811 00:50:23.458936 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.458939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.459124 (+ 185us) server_negotiation.cc:407] Connection header received
0811 00:50:23.459173 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.459174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.459185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.459233 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:23.459377 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.459854 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.460804 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.461158 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.461220 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.461227 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.461415 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.461451 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:23.461795 28509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91392f06ce334560881cf55d4bb2203a" candidate_uuid: "5833e1621e594cc28573db6735eece81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e225ba5f89c341b58b098ff197299c85" is_pre_election: true
I20260811 00:50:23.461865 28272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91392f06ce334560881cf55d4bb2203a" candidate_uuid: "5833e1621e594cc28573db6735eece81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c02671649d574292b8010ffe90af4744" is_pre_election: true
I20260811 00:50:23.462023 28272 raft_consensus.cc:2454] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5833e1621e594cc28573db6735eece81 in term 0.
I20260811 00:50:23.462024 28509 raft_consensus.cc:2454] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5833e1621e594cc28573db6735eece81 in term 0.
I20260811 00:50:23.462327 28640 leader_election.cc:302] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5833e1621e594cc28573db6735eece81, c02671649d574292b8010ffe90af4744; no voters:
I20260811 00:50:23.462494 28883 raft_consensus.cc:2781] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:23.462558 28883 raft_consensus.cc:482] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:23.462574 28883 raft_consensus.cc:3037] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:23.463302 28883 raft_consensus.cc:504] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.463467 28883 leader_election.cc:288] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [CANDIDATE]: Term 1 election: Requested vote from peers e225ba5f89c341b58b098ff197299c85 (127.26.99.130:45831), c02671649d574292b8010ffe90af4744 (127.26.99.129:34129)
I20260811 00:50:23.463692 28509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91392f06ce334560881cf55d4bb2203a" candidate_uuid: "5833e1621e594cc28573db6735eece81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e225ba5f89c341b58b098ff197299c85"
I20260811 00:50:23.463713 28272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91392f06ce334560881cf55d4bb2203a" candidate_uuid: "5833e1621e594cc28573db6735eece81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c02671649d574292b8010ffe90af4744"
I20260811 00:50:23.463788 28509 raft_consensus.cc:3037] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:23.463791 28272 raft_consensus.cc:3037] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:23.464717 28272 raft_consensus.cc:2454] T 91392f06ce334560881cf55d4bb2203a P c02671649d574292b8010ffe90af4744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5833e1621e594cc28573db6735eece81 in term 1.
I20260811 00:50:23.464758 28509 raft_consensus.cc:2454] T 91392f06ce334560881cf55d4bb2203a P e225ba5f89c341b58b098ff197299c85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5833e1621e594cc28573db6735eece81 in term 1.
I20260811 00:50:23.464927 28637 leader_election.cc:302] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5833e1621e594cc28573db6735eece81, e225ba5f89c341b58b098ff197299c85; no voters:
I20260811 00:50:23.465029 28883 raft_consensus.cc:2781] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:23.465183 28883 raft_consensus.cc:686] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [term 1 LEADER]: Becoming Leader. State: Replica: 5833e1621e594cc28573db6735eece81, State: Running, Role: LEADER
I20260811 00:50:23.465288 28883 consensus_queue.cc:237] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } }
I20260811 00:50:23.466276 28009 catalog_manager.cc:5495] T 91392f06ce334560881cf55d4bb2203a P 5833e1621e594cc28573db6735eece81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5833e1621e594cc28573db6735eece81 (127.26.99.131). New cstate: current_term: 1 leader_uuid: "5833e1621e594cc28573db6735eece81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e225ba5f89c341b58b098ff197299c85" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5833e1621e594cc28573db6735eece81" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 35511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c02671649d574292b8010ffe90af4744" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 34129 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:23.508056 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.501000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41592 (local address 127.26.99.129:34129)
0811 00:50:23.501082 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.501084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.501149 (+ 65us) server_negotiation.cc:407] Connection header received
0811 00:50:23.501215 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.501216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.501227 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.501275 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.501863 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.502349 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.503059 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.503250 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.503308 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.505677 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.505690 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.505690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.505698 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.507057 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.507361 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.507363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.507364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.507422 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.507552 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.507552 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.507552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.507679 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.507778 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.507900 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.507973 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:23.532290 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.525190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41596 (local address 127.26.99.129:34129)
0811 00:50:23.525274 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.525276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.525350 (+ 74us) server_negotiation.cc:407] Connection header received
0811 00:50:23.525384 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.525385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.525397 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.525474 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.526086 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.526599 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.527337 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.527546 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.527605 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.529924 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.529925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.529926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.529934 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.531127 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.531435 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.531436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.531437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.531489 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.531749 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.531750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.531750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.531852 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.531941 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.532114 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.532196 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[27928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:23.557214 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:23.549967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.26.99.129:34129)
0811 00:50:23.550043 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:23.550045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:23.550105 (+ 60us) server_negotiation.cc:407] Connection header received
0811 00:50:23.550212 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:23.550213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:23.550223 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:23.550359 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:23.550916 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.551397 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.552109 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:23.552293 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:23.552392 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:23.554641 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:23.554643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:23.554643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:23.554650 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:23.555975 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.556327 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.556328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.556328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.556430 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:23.556673 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:23.556674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:23.556675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:23.556799 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:23.556877 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:23.557047 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 00:50:23.557118 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 00:50:23.557914 28201 tablet_service.cc:2908] Rejecting scan request for tablet 91392f06ce334560881cf55d4bb2203a: Uninitialized: clean time has not yet been initialized
I20260811 00:50:23.558996 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28125
I20260811 00:50:23.572047 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28361
I20260811 00:50:23.583240 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28599
I20260811 00:50:23.598711 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27957
2026-08-11T00:50:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3455 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[28915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[28915](info): set up 2 sockets
Aug 11 00:50:23 dist-test-slave-xt4k krb5kdc[28915](info): commencing operation
krb5kdc: starting...
W20260811 00:50:24.798842 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:24 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:24.912576 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34719
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:34719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:24.992367 28935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:24.992554 28935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:24.992574 28935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:24.993641 28935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:24.993671 28935 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:50:24.993683 28935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:24.993695 28935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:24.993705 28935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:24.993716 28935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:24.995111 28935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:34719
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:24.995289 28935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:24.995457 28935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:25.000000 28944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:24.999979 28949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:25.000025 28935 server_base.cc:1034] running on GCE node
W20260811 00:50:24.999977 28946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:25.000365 28935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:25.000658 28935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:25.001796 28935 hybrid_clock.cc:648] HybridClock initialized: now 1786409425001784 us; error 30 us; skew 500 ppm
Aug 11 00:50:24 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409424, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:25.004088 28935 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:25.004612 28935 webserver.cc:460] Webserver started at http://127.26.99.190:33033/ using document root <none> and password file <none>
I20260811 00:50:25.004841 28935 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:25.004890 28935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:25.005015 28935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:25.005988 28935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "4ad052e5f2434aeb9af3816ed84a8e78"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "567ff2b045ba21a473e2f0bf3dfcf779"
server_key_iv: "6a17183515a9119fc2e2c4addebadc79"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.006330 28935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "4ad052e5f2434aeb9af3816ed84a8e78"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "567ff2b045ba21a473e2f0bf3dfcf779"
server_key_iv: "6a17183515a9119fc2e2c4addebadc79"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.007584 28935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:25.008255 28962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.008431 28935 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:25.008517 28935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "4ad052e5f2434aeb9af3816ed84a8e78"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "567ff2b045ba21a473e2f0bf3dfcf779"
server_key_iv: "6a17183515a9119fc2e2c4addebadc79"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.008584 28935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:25.022172 28935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:25.024025 28935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:25.024163 28935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:25.028972 28935 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:34719
I20260811 00:50:25.029052 29077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:34719 every 8 connection(s)
I20260811 00:50:25.029335 28935 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:25.030018 29079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.032586 29079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Bootstrap starting.
I20260811 00:50:25.033167 29079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.033437 29079 log.cc:824] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:25.034093 29079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: No bootstrap required, opened a new log
I20260811 00:50:25.036455 29079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } }
I20260811 00:50:25.036609 29079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.036633 29079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ad052e5f2434aeb9af3816ed84a8e78, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.036761 29079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } }
I20260811 00:50:25.036799 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28935
I20260811 00:50:25.036836 29079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:25.036860 29079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:25.036885 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:25.036907 29079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.037038 27022 external_mini_cluster.cc:1428] Setting key 7c55d89a6f900b8e59c8da9517d6dd53
I20260811 00:50:25.037458 29079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } }
I20260811 00:50:25.037569 29079 leader_election.cc:302] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ad052e5f2434aeb9af3816ed84a8e78; no voters:
I20260811 00:50:25.037772 29079 leader_election.cc:288] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:25.037810 29085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:25.037911 29085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [term 1 LEADER]: Becoming Leader. State: Replica: 4ad052e5f2434aeb9af3816ed84a8e78, State: Running, Role: LEADER
I20260811 00:50:25.038046 29079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:25.038054 29085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } }
I20260811 00:50:25.038467 29086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } } }
I20260811 00:50:25.038558 29086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:25.039095 29091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:25.038767 29087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ad052e5f2434aeb9af3816ed84a8e78. Latest consensus state: current_term: 1 leader_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ad052e5f2434aeb9af3816ed84a8e78" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34719 } } }
I20260811 00:50:25.039463 29087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:25.039641 29091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:25.041224 29091 catalog_manager.cc:1347] Generated new cluster ID: 6c58af2c82354b969d2538193c5eddcc
I20260811 00:50:25.041275 29091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.049309 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.037515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44644 (local address 127.26.99.190:34719)
0811 00:50:25.037679 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.037688 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.037720 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:50:25.037817 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.037824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.037879 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.038715 (+ 836us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.038825 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.040199 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.041100 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.041702 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.041834 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.044523 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.044528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.044529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.044541 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.047363 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.047733 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.047736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.047736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.047863 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.048039 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.048040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.048040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.048403 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.048590 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.048857 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.049098 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
I20260811 00:50:25.067250 29091 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:25.068017 29091 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:25.072573 29091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Generated new TSK 0
I20260811 00:50:25.072757 29091 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:25.100697 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34719
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:25.183452 29116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:25.183665 29116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:25.183688 29116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:25.184870 29116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:25.184906 29116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:25.184926 29116 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:25.184942 29116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:25.186420 29116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:34719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:25.186632 29116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:25.186816 29116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:25.191740 29124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.191745 29123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.191758 29128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:25.191913 29116 server_base.cc:1034] running on GCE node
I20260811 00:50:25.192174 29116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:25.192415 29116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:25.193563 29116 hybrid_clock.cc:648] HybridClock initialized: now 1786409425193559 us; error 40 us; skew 500 ppm
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:25.196103 29116 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:25.196651 29116 webserver.cc:460] Webserver started at http://127.26.99.129:44075/ using document root <none> and password file <none>
I20260811 00:50:25.196905 29116 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:25.196966 29116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:25.197098 29116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:25.198143 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "9d4ce613343c43a6aec36d779d48eca6"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "0cfb348e633afe19565a785e15fccfd1"
server_key_iv: "29190df77a685514e52a5b6e6da8df09"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.198477 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "9d4ce613343c43a6aec36d779d48eca6"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "0cfb348e633afe19565a785e15fccfd1"
server_key_iv: "29190df77a685514e52a5b6e6da8df09"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.199862 29116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:25.200661 29140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.200861 29116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:25.200970 29116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "9d4ce613343c43a6aec36d779d48eca6"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "0cfb348e633afe19565a785e15fccfd1"
server_key_iv: "29190df77a685514e52a5b6e6da8df09"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.201036 29116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:25.218212 29116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:25.220117 29116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:25.220259 29116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:25.220813 29116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:25.220853 29116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.220888 29116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:25.220917 29116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.227806 29116 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:46607
I20260811 00:50:25.227876 29350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:46607 every 8 connection(s)
I20260811 00:50:25.228221 29116 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:25.230319 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.221418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:55175 (local address 127.26.99.190:34719)
0811 00:50:25.221465 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.221467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.221709 (+ 242us) server_negotiation.cc:407] Connection header received
0811 00:50:25.222268 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.222270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.222290 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.222367 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.223039 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.223809 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.225296 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.225617 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.225706 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.227873 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.227875 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.227875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.227886 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.229268 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.229636 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.229637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.229637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.229684 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.229856 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.229856 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.229856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.229958 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.230004 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.230196 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.230258 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:50:25.230520 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.221419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.129:55175)
0811 00:50:25.221591 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.221626 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.222130 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.222472 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.222476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.222751 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.222953 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.222958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.223915 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.223916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.225206 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.225209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.225739 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.225740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.225888 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.226412 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.226429 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.227781 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.229339 (+ 1558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.229345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.229347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.229573 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.229727 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.229728 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.229728 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.229815 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.229999 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.230002 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.230109 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.230184 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.230299 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260811 00:50:25.230983 29351 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34719
I20260811 00:50:25.231067 29351 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:25.231237 29351 heartbeater.cc:511] Master 127.26.99.190:34719 requested a full tablet report, sending...
I20260811 00:50:25.231755 28992 ts_manager.cc:194] Registered new tserver with Master: 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607)
I20260811 00:50:25.232577 28992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:55175
I20260811 00:50:25.236474 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29116
I20260811 00:50:25.236578 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:25.236773 27022 external_mini_cluster.cc:1428] Setting key 26d11ea44910d4337c7052743fd6e5fb
I20260811 00:50:25.237200 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.232086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:60417 (local address 127.26.99.190:34719)
0811 00:50:25.232126 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.232128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.232187 (+ 59us) server_negotiation.cc:407] Connection header received
0811 00:50:25.232232 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.232233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.232242 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.232301 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.232611 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.233221 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.233878 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.234070 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.234122 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.234882 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.234883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.234883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.234888 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.236054 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.236397 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.236399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.236400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.236489 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.236688 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.236689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.236689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.236827 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.236891 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.237069 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.237145 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:25.237221 29361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.232017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.129:60417)
0811 00:50:25.232136 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.232145 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.232195 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.232306 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.232306 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.232498 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.232547 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.232549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.233308 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.233309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.233805 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.233807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.234126 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.234127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.234181 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.234557 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.234562 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.234813 (+ 251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.236131 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.236132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.236132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.236303 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.236565 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.236566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.236566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.236632 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.236923 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.236924 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.236975 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.237033 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.237125 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:25.260504 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34719
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:25.341363 29364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:25.341571 29364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:25.341602 29364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:25.342756 29364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:25.342800 29364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:25.342819 29364 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:25.342835 29364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:25.344251 29364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:34719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:25.344502 29364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:25.344719 29364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:25.349712 29364 server_base.cc:1034] running on GCE node
W20260811 00:50:25.349658 29375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.349659 29374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.349658 29377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:25.350109 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:25.350356 29364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:25.351521 29364 hybrid_clock.cc:648] HybridClock initialized: now 1786409425351506 us; error 32 us; skew 500 ppm
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:25.354080 29364 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:25.354543 29364 webserver.cc:460] Webserver started at http://127.26.99.130:46853/ using document root <none> and password file <none>
I20260811 00:50:25.354756 29364 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:25.354804 29364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:25.354933 29364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:25.355957 29364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "9051d1d568044b87a4eac3e01f03bb48"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "915b3aa950e8fde300ec5a1b445f98e0"
server_key_iv: "728c8be00a432ce8e09554f002effac8"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.356295 29364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "9051d1d568044b87a4eac3e01f03bb48"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "915b3aa950e8fde300ec5a1b445f98e0"
server_key_iv: "728c8be00a432ce8e09554f002effac8"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.357657 29364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:25.358359 29392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.358513 29364 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:25.358598 29364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "9051d1d568044b87a4eac3e01f03bb48"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "915b3aa950e8fde300ec5a1b445f98e0"
server_key_iv: "728c8be00a432ce8e09554f002effac8"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.358666 29364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:25.374472 29364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:25.376653 29364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:25.376796 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:25.377339 29364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:25.377381 29364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.377413 29364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:25.377439 29364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.385972 29364 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:37291
I20260811 00:50:25.386435 29364 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:25.386649 29590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:37291 every 8 connection(s)
I20260811 00:50:25.388068 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.377714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37219 (local address 127.26.99.190:34719)
0811 00:50:25.377779 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.377781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.377991 (+ 210us) server_negotiation.cc:407] Connection header received
0811 00:50:25.378701 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.378702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.378718 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.378788 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.379676 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.380189 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.382371 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.382609 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.382683 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.385038 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.385039 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.385040 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.385049 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.386475 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.386919 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.386920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.386921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.386987 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.387364 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.387365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.387366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.387500 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.387591 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.387921 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.387999 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:50:25.388188 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.377686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.130:37219)
0811 00:50:25.377844 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.377894 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.378582 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.378881 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.378886 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.379262 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.379577 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.379583 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.380282 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.380284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.382185 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.382196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.382725 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.382726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.382862 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.383486 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.383498 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.384931 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.386553 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.386561 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.386564 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.386855 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.387094 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.387097 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.387097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.387260 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.387618 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.387624 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.387765 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.387862 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.388005 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260811 00:50:25.388875 29591 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34719
I20260811 00:50:25.388969 29591 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:25.389164 29591 heartbeater.cc:511] Master 127.26.99.190:34719 requested a full tablet report, sending...
I20260811 00:50:25.389519 28992 ts_manager.cc:194] Registered new tserver with Master: 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130:37291)
I20260811 00:50:25.389945 28992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:37219
I20260811 00:50:25.394950 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.389974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:53805 (local address 127.26.99.190:34719)
0811 00:50:25.390022 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.390024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.390113 (+ 89us) server_negotiation.cc:407] Connection header received
0811 00:50:25.390181 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.390182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.390192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.390237 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.390542 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.391023 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.391687 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.391882 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.391935 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.392755 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.392756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.392757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.392764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.393924 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.394226 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.394227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.394228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.394280 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.394440 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.394440 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.394441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.394584 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.394651 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.394785 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.394857 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:50:25.394963 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.389869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.130:53805)
0811 00:50:25.390053 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.390064 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.390134 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.390239 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.390240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.390415 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.390473 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.390475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.391110 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.391111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.391613 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.391614 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.391941 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.391942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.392015 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.392405 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.392409 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.392677 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.393997 (+ 1320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.393998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.393998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.394166 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.394333 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.394333 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.394334 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.394390 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.394645 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.394646 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.394694 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.394754 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.394859 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260811 00:50:25.395668 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29364
I20260811 00:50:25.395758 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:25.395943 27022 external_mini_cluster.cc:1428] Setting key bb7110837ac2d7c92ac670316e75b2ca
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:25.423164 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34719
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:25.505749 29614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:25.505949 29614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:25.505980 29614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:25.507122 29614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:25.507161 29614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:25.507189 29614 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:25.507213 29614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:25.508756 29614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:34719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:25.508991 29614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:25.509205 29614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:25.514300 29614 server_base.cc:1034] running on GCE node
W20260811 00:50:25.514338 29624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.514328 29623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:25.514420 29628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:25.514681 29614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:25.514910 29614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:25.516062 29614 hybrid_clock.cc:648] HybridClock initialized: now 1786409425516046 us; error 34 us; skew 500 ppm
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:25.518587 29614 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:25.519059 29614 webserver.cc:460] Webserver started at http://127.26.99.131:44455/ using document root <none> and password file <none>
I20260811 00:50:25.519284 29614 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:25.519332 29614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:25.519454 29614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:25.520524 29614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "18a8e2b4b180ea13aecc78768ce78d86"
server_key_iv: "8f4e6c78af363438a0647793152edfe2"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.520854 29614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "18a8e2b4b180ea13aecc78768ce78d86"
server_key_iv: "8f4e6c78af363438a0647793152edfe2"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.522084 29614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:25.522783 29635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.522948 29614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:25.523032 29614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
format_stamp: "Formatted at 2026-08-11 00:50:25 on dist-test-slave-xt4k"
server_key: "18a8e2b4b180ea13aecc78768ce78d86"
server_key_iv: "8f4e6c78af363438a0647793152edfe2"
server_key_version: "encryptionkey@0"
I20260811 00:50:25.523092 29614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:25.543744 29614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:25.545562 29614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:25.545699 29614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:25.546211 29614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:25.546264 29614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.546294 29614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:25.546315 29614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.552995 29614 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39499
I20260811 00:50:25.553061 29859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39499 every 8 connection(s)
I20260811 00:50:25.553362 29614 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:25.555668 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.546629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:36287 (local address 127.26.99.190:34719)
0811 00:50:25.546672 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.546675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.546892 (+ 217us) server_negotiation.cc:407] Connection header received
0811 00:50:25.547385 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.547386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.547400 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.547439 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.548204 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.548977 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.550511 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.550814 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.550888 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.553375 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.553377 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.553377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.553386 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.554589 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.554977 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.554978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.554978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.555023 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.555192 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.555192 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.555192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.555289 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.555337 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.555543 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.555604 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:25.555837 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.546641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.131:36287)
0811 00:50:25.546780 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.546814 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.547288 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.547514 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.547517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.547809 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.548091 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.548097 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.549101 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.549102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.550416 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.550420 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.550914 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.550915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.551073 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.551548 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.551558 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.553283 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.554657 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.554663 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.554664 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.554921 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.555063 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.555064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.555064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.555153 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.555334 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.555336 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.555446 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.555522 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.555641 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
I20260811 00:50:25.556288 29860 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34719
I20260811 00:50:25.556389 29860 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:25.556582 29860 heartbeater.cc:511] Master 127.26.99.190:34719 requested a full tablet report, sending...
I20260811 00:50:25.556949 28993 ts_manager.cc:194] Registered new tserver with Master: 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499)
I20260811 00:50:25.557324 28993 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:36287
I20260811 00:50:25.558734 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29614
I20260811 00:50:25.558810 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:25.558960 27022 external_mini_cluster.cc:1428] Setting key 3282c89e9baac03984e6525ca6cda7ac
I20260811 00:50:25.559777 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:25.562574 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.557350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:40523 (local address 127.26.99.190:34719)
0811 00:50:25.557388 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.557390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.557449 (+ 59us) server_negotiation.cc:407] Connection header received
0811 00:50:25.557539 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.557540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.557550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.557618 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.557958 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.558399 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.559166 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.559436 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.559493 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.560287 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.560288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.560288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.560295 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.561580 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.561891 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.561892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.561892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.561951 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.562107 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.562107 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.562108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.562210 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.562264 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.562400 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.562494 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:25.562762 29875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.557278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.26.99.131:40523)
0811 00:50:25.557388 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.557398 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.557474 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.557622 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.557622 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.557821 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.557877 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.557879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.558481 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.558482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.559062 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.559064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.559509 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.559510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.559587 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.559955 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.559959 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.560207 (+ 248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.561645 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.561646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.561646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.561814 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.562003 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.562004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.562004 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.562057 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.562263 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.562263 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.562308 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.562362 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.562474 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":63,"threads_started":1}
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.582420 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.576235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.26.99.190:34719)
0811 00:50:25.576283 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.576285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.576291 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:50:25.576313 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.576314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.576322 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.576392 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.576907 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.577385 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.578058 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.578261 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.578319 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.580389 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.580390 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.580390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.580396 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.581470 (+ 1074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.581799 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.581801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.581801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.581864 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.582008 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.582008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.582008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.582107 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.582187 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.582259 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.582325 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:25.583928 28993 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:25.585515 28993 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:25.591980 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.587627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39499 (local address 127.0.0.1:37594)
0811 00:50:25.587776 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.587820 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.587880 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.588221 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.588224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.588226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.588294 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.588296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589571 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.589572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.590868 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.590871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591728 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.591797 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591801 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.591848 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.591882 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":119,"threads_started":1}
I20260811 00:50:25.591989 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.587909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37594 (local address 127.26.99.131:39499)
0811 00:50:25.588070 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.588075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.588083 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:25.588121 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.588123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.588138 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.588215 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.588504 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589494 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.590960 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591634 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591723 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591772 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.591863 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.591896 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":101,"threads_started":1}
I20260811 00:50:25.591898 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.587626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:37291 (local address 127.0.0.1:32802)
0811 00:50:25.587813 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.587823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.587880 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.588376 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.588377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.588379 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.588434 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.588436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589800 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.589801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.590887 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.590889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591613 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.591695 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591708 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.591773 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.591824 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":25,"thread_start_us":89,"threads_started":1}
I20260811 00:50:25.592163 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.588174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59324 (local address 127.26.99.129:46607)
0811 00:50:25.588384 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.588388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.588396 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:25.588432 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.588434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.588473 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.588674 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.588810 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589854 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.590836 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591575 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591645 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591705 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.592033 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.592078 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":75,"threads_started":1}
I20260811 00:50:25.591993 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.587939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46607 (local address 127.0.0.1:59324)
0811 00:50:25.588066 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.588075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.588120 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.588691 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.588692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.588695 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.588733 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.588734 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589936 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.589937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.590759 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.590762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591739 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.591800 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591805 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.591849 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.591891 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":80,"threads_started":1}
I20260811 00:50:25.592290 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.587727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.26.99.130:37291)
0811 00:50:25.588204 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.588209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.588218 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:25.588252 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.588254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.588269 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.588389 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.588524 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.589682 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.590976 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.591536 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.591599 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.591658 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.591937 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.591978 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":89,"threads_started":1}
I20260811 00:50:25.592998 29736 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc32e09cd8e46adbafab47577b892ba (DEFAULT_TABLE table=test-table [id=9f998758780e4bfb93fb22afb3c92a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.592998 29492 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc32e09cd8e46adbafab47577b892ba (DEFAULT_TABLE table=test-table [id=9f998758780e4bfb93fb22afb3c92a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.593098 29238 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc32e09cd8e46adbafab47577b892ba (DEFAULT_TABLE table=test-table [id=9f998758780e4bfb93fb22afb3c92a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.593361 29492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc32e09cd8e46adbafab47577b892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.593361 29736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc32e09cd8e46adbafab47577b892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.593418 29238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc32e09cd8e46adbafab47577b892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.596076 29908 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Bootstrap starting.
I20260811 00:50:25.596477 29909 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Bootstrap starting.
I20260811 00:50:25.596868 29908 tablet_bootstrap.cc:654] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.597070 29911 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Bootstrap starting.
I20260811 00:50:25.597343 29908 log.cc:824] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:25.597432 29909 tablet_bootstrap.cc:654] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.597604 29911 tablet_bootstrap.cc:654] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.597769 29909 log.cc:824] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:25.597877 29911 log.cc:824] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:25.598207 29908 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: No bootstrap required, opened a new log
I20260811 00:50:25.598258 29908 ts_tablet_manager.cc:1397] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:25.598532 29911 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: No bootstrap required, opened a new log
I20260811 00:50:25.598578 29911 ts_tablet_manager.cc:1397] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:25.598585 29909 tablet_bootstrap.cc:492] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: No bootstrap required, opened a new log
I20260811 00:50:25.598642 29909 ts_tablet_manager.cc:1397] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:25.599989 29911 raft_consensus.cc:348] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.600106 29911 raft_consensus.cc:374] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.600126 29911 raft_consensus.cc:729] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9051d1d568044b87a4eac3e01f03bb48, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.600216 29911 consensus_queue.cc:260] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.600246 29908 raft_consensus.cc:348] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.600421 29908 raft_consensus.cc:374] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.600469 29908 raft_consensus.cc:729] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d4ce613343c43a6aec36d779d48eca6, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.600486 29911 ts_tablet_manager.cc:1428] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:50:25.600596 29591 heartbeater.cc:503] Master 127.26.99.190:34719 was elected leader, sending a full tablet report...
I20260811 00:50:25.600576 29908 consensus_queue.cc:260] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.600539 29909 raft_consensus.cc:348] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.600666 29909 raft_consensus.cc:374] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.600699 29909 raft_consensus.cc:729] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6906bac28ab34a74ab7adb2cd1f758a7, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.600800 29909 consensus_queue.cc:260] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.603127 29909 ts_tablet_manager.cc:1428] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20260811 00:50:25.603135 29908 ts_tablet_manager.cc:1428] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 00:50:25.603241 29351 heartbeater.cc:503] Master 127.26.99.190:34719 was elected leader, sending a full tablet report...
I20260811 00:50:25.603523 29860 heartbeater.cc:503] Master 127.26.99.190:34719 was elected leader, sending a full tablet report...
W20260811 00:50:25.637156 29594 tablet.cc:2369] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:25.637665 29916 raft_consensus.cc:482] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:25.637782 29916 raft_consensus.cc:504] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.638166 29916 leader_election.cc:288] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499), 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130:37291)
I20260811 00:50:25.641008 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.638394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:53635 (local address 127.26.99.131:39499)
0811 00:50:25.638440 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.638442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.638452 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:25.638485 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.638486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.638495 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.638550 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.638722 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.639249 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640296 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.640682 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640747 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.640756 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.640905 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.640943 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:25.641055 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.638332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39499 (local address 127.26.99.129:53635)
0811 00:50:25.638385 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.638396 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.638437 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.638577 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.638579 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.638580 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.638658 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.638660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.639339 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.639340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.640213 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.640215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.640759 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.640842 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.640845 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.640892 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.640933 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":79}
I20260811 00:50:25.641070 29920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.638351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:37291 (local address 127.26.99.129:40629)
0811 00:50:25.638524 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.638531 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.638575 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.638700 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.638701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.638703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.638773 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.638774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.639461 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.639462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.640236 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.640238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.640792 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.640870 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.640873 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.640925 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.640968 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":1,"thread_start_us":115,"threads_started":1}
I20260811 00:50:25.641040 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.638386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:40629 (local address 127.26.99.130:37291)
0811 00:50:25.638466 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.638468 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.638582 (+ 114us) server_negotiation.cc:407] Connection header received
0811 00:50:25.638625 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.638626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.638636 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.638694 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.638827 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.639391 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640319 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.640718 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.640778 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.640786 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.640944 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.640977 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 00:50:25.641397 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc32e09cd8e46adbafab47577b892ba" candidate_uuid: "9d4ce613343c43a6aec36d779d48eca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" is_pre_election: true
I20260811 00:50:25.641539 29782 raft_consensus.cc:2454] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d4ce613343c43a6aec36d779d48eca6 in term 0.
I20260811 00:50:25.641649 29521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc32e09cd8e46adbafab47577b892ba" candidate_uuid: "9d4ce613343c43a6aec36d779d48eca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9051d1d568044b87a4eac3e01f03bb48" is_pre_election: true
I20260811 00:50:25.641786 29521 raft_consensus.cc:2454] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d4ce613343c43a6aec36d779d48eca6 in term 0.
I20260811 00:50:25.641824 29143 leader_election.cc:302] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6906bac28ab34a74ab7adb2cd1f758a7, 9d4ce613343c43a6aec36d779d48eca6; no voters:
I20260811 00:50:25.641997 29916 raft_consensus.cc:2781] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:25.642040 29916 raft_consensus.cc:482] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:25.642055 29916 raft_consensus.cc:3037] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.642973 29916 raft_consensus.cc:504] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.643105 29916 leader_election.cc:288] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [CANDIDATE]: Term 1 election: Requested vote from peers 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499), 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130:37291)
I20260811 00:50:25.643272 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc32e09cd8e46adbafab47577b892ba" candidate_uuid: "9d4ce613343c43a6aec36d779d48eca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
I20260811 00:50:25.643321 29521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc32e09cd8e46adbafab47577b892ba" candidate_uuid: "9d4ce613343c43a6aec36d779d48eca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9051d1d568044b87a4eac3e01f03bb48"
I20260811 00:50:25.643365 29782 raft_consensus.cc:3037] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.643386 29521 raft_consensus.cc:3037] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.644253 29782 raft_consensus.cc:2454] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d4ce613343c43a6aec36d779d48eca6 in term 1.
I20260811 00:50:25.644253 29521 raft_consensus.cc:2454] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d4ce613343c43a6aec36d779d48eca6 in term 1.
I20260811 00:50:25.644500 29144 leader_election.cc:302] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9051d1d568044b87a4eac3e01f03bb48, 9d4ce613343c43a6aec36d779d48eca6; no voters:
I20260811 00:50:25.644589 29916 raft_consensus.cc:2781] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:25.644738 29916 raft_consensus.cc:686] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 1 LEADER]: Becoming Leader. State: Replica: 9d4ce613343c43a6aec36d779d48eca6, State: Running, Role: LEADER
I20260811 00:50:25.644826 29916 consensus_queue.cc:237] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } }
I20260811 00:50:25.645682 28993 catalog_manager.cc:5495] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "9d4ce613343c43a6aec36d779d48eca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:25.654623 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.652173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.26.99.129:46607)
0811 00:50:25.652220 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.652222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.652230 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:25.652301 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.652302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.652316 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.652416 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:25.652546 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.653091 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.653891 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.654076 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.654127 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.654312 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:25.654403 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:25.654457 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.654511 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.654530 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:25.656466 29782 raft_consensus.cc:1261] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Refusing update from remote peer 9d4ce613343c43a6aec36d779d48eca6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:25.656464 29521 raft_consensus.cc:1261] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Refusing update from remote peer 9d4ce613343c43a6aec36d779d48eca6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:25.656857 29921 consensus_queue.cc:1035] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:25.659415 29927 mvcc.cc:205] Tried to move back new op lower bound from 7317133007485730816 to 7317133007441838080. Current Snapshot: MvccSnapshot[applied={T|T < 7317133007485730816}]
I20260811 00:50:25.659534 29916 consensus_queue.cc:1035] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:25.664019 28993 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:25.664142 28993 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:25.665012 28993 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Sending DeleteTablet for 3 replicas of tablet 9fc32e09cd8e46adbafab47577b892ba
I20260811 00:50:25.665488 29492 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc32e09cd8e46adbafab47577b892ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:25 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:32802
I20260811 00:50:25.665488 29736 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc32e09cd8e46adbafab47577b892ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:25 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:37594
I20260811 00:50:25.665675 29238 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc32e09cd8e46adbafab47577b892ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:25 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:59324
I20260811 00:50:25.665716 29947 tablet_replica.cc:330] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: stopping tablet replica
I20260811 00:50:25.665812 29947 raft_consensus.cc:2229] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:25.665917 29946 tablet_replica.cc:330] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: stopping tablet replica
I20260811 00:50:25.665935 29947 raft_consensus.cc:2258] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:25.666146 29946 raft_consensus.cc:2229] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:25.666108 28993 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:25.666246 28993 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:25.666416 29947 ts_tablet_manager.cc:1905] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:25.666450 29946 raft_consensus.cc:2258] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:25.667164 29949 tablet_replica.cc:330] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: stopping tablet replica
I20260811 00:50:25.667316 29949 raft_consensus.cc:2229] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:25.667438 29946 ts_tablet_manager.cc:1905] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:25.667546 29949 raft_consensus.cc:2258] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:25.668035 29736 tablet_service.cc:1467] Processing CreateTablet for tablet bfa7d5173a484a40856aa474f534991f (DEFAULT_TABLE table=test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.668166 29736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa7d5173a484a40856aa474f534991f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.669145 29946 ts_tablet_manager.cc:1918] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:25.669281 29946 log.cc:1196] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/9fc32e09cd8e46adbafab47577b892ba
I20260811 00:50:25.669514 29492 tablet_service.cc:1467] Processing CreateTablet for tablet bfa7d5173a484a40856aa474f534991f (DEFAULT_TABLE table=test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.669647 29492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa7d5173a484a40856aa474f534991f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.669842 29946 ts_tablet_manager.cc:1939] T 9fc32e09cd8e46adbafab47577b892ba P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting consensus metadata
I20260811 00:50:25.670647 29947 ts_tablet_manager.cc:1918] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:25.670712 29947 log.cc:1196] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/9fc32e09cd8e46adbafab47577b892ba
I20260811 00:50:25.670930 29911 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Bootstrap starting.
I20260811 00:50:25.671062 29909 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Bootstrap starting.
I20260811 00:50:25.671195 29949 ts_tablet_manager.cc:1905] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:25.671372 29911 tablet_bootstrap.cc:654] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.671533 29909 tablet_bootstrap.cc:654] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.672044 29911 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: No bootstrap required, opened a new log
I20260811 00:50:25.672093 29911 ts_tablet_manager.cc:1397] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:25.672071 28969 catalog_manager.cc:4841] TS 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499): tablet 9fc32e09cd8e46adbafab47577b892ba (table test-table [id=9f998758780e4bfb93fb22afb3c92a86]) successfully deleted
I20260811 00:50:25.672252 29911 raft_consensus.cc:348] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.672317 29911 raft_consensus.cc:374] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.672358 29911 raft_consensus.cc:729] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9051d1d568044b87a4eac3e01f03bb48, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.672313 29238 tablet_service.cc:1467] Processing CreateTablet for tablet bfa7d5173a484a40856aa474f534991f (DEFAULT_TABLE table=test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:25.672401 29911 consensus_queue.cc:260] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.672443 29238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfa7d5173a484a40856aa474f534991f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.672478 29911 ts_tablet_manager.cc:1428] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.672828 29949 ts_tablet_manager.cc:1918] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:25.672899 29949 log.cc:1196] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/9fc32e09cd8e46adbafab47577b892ba
I20260811 00:50:25.673161 29949 ts_tablet_manager.cc:1939] T 9fc32e09cd8e46adbafab47577b892ba P 9d4ce613343c43a6aec36d779d48eca6: Deleting consensus metadata
I20260811 00:50:25.670931 29947 ts_tablet_manager.cc:1939] T 9fc32e09cd8e46adbafab47577b892ba P 9051d1d568044b87a4eac3e01f03bb48: Deleting consensus metadata
I20260811 00:50:25.673578 28969 catalog_manager.cc:4841] TS 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607): tablet 9fc32e09cd8e46adbafab47577b892ba (table test-table [id=9f998758780e4bfb93fb22afb3c92a86]) successfully deleted
I20260811 00:50:25.673797 29908 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Bootstrap starting.
I20260811 00:50:25.673837 28972 catalog_manager.cc:4841] TS 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130:37291): tablet 9fc32e09cd8e46adbafab47577b892ba (table test-table [id=9f998758780e4bfb93fb22afb3c92a86]) successfully deleted
I20260811 00:50:25.674357 29908 tablet_bootstrap.cc:654] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.675006 29908 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: No bootstrap required, opened a new log
I20260811 00:50:25.675063 29908 ts_tablet_manager.cc:1397] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:25.675230 29908 raft_consensus.cc:348] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.675307 29908 raft_consensus.cc:374] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.675333 29908 raft_consensus.cc:729] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d4ce613343c43a6aec36d779d48eca6, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.675381 29908 consensus_queue.cc:260] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.675468 29908 ts_tablet_manager.cc:1428] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:25.676695 29909 tablet_bootstrap.cc:492] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: No bootstrap required, opened a new log
I20260811 00:50:25.676750 29909 ts_tablet_manager.cc:1397] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20260811 00:50:25.676892 29909 raft_consensus.cc:348] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.676968 29909 raft_consensus.cc:374] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.676988 29909 raft_consensus.cc:729] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6906bac28ab34a74ab7adb2cd1f758a7, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.677032 29909 consensus_queue.cc:260] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.677116 29909 ts_tablet_manager.cc:1428] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:25.716918 29915 raft_consensus.cc:482] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:25.717022 29915 raft_consensus.cc:504] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.717342 29915 leader_election.cc:288] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607), 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499)
I20260811 00:50:25.720690 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.717628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:38865 (local address 127.26.99.129:46607)
0811 00:50:25.717686 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.717688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.717697 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:25.717777 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.717779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.717791 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.717836 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.718022 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.718545 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.719700 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.720250 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.720321 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.720331 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.720575 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.720622 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:50:25.720709 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.717567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46607 (local address 127.26.99.130:38865)
0811 00:50:25.717618 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.717631 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.717678 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.717888 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.717890 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.717892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.717966 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.717968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.718612 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.718613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.719602 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.719605 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.720396 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.720398 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.720494 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.720498 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.720556 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.720597 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:50:25.720983 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.717791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:49085 (local address 127.26.99.131:39499)
0811 00:50:25.717827 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.717829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.717925 (+ 96us) server_negotiation.cc:407] Connection header received
0811 00:50:25.717987 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.717988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.717997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.718068 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:25.718203 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.718935 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.720096 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.720580 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.720627 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.720635 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.720869 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.720910 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:25.721016 29276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa7d5173a484a40856aa474f534991f" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d4ce613343c43a6aec36d779d48eca6" is_pre_election: true
I20260811 00:50:25.721148 29276 raft_consensus.cc:2454] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 0.
I20260811 00:50:25.721184 29960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.717710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39499 (local address 127.26.99.130:49085)
0811 00:50:25.717862 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.717870 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.717930 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.718073 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.718073 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.718075 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:25.718136 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.718137 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.719026 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.719027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.719984 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.719986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.720711 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.720712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.720782 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.720786 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.721055 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.721099 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260811 00:50:25.721416 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa7d5173a484a40856aa474f534991f" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" is_pre_election: true
I20260811 00:50:25.721462 29397 leader_election.cc:302] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9051d1d568044b87a4eac3e01f03bb48, 9d4ce613343c43a6aec36d779d48eca6; no voters:
I20260811 00:50:25.721522 29782 raft_consensus.cc:2454] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 0.
I20260811 00:50:25.721589 29915 raft_consensus.cc:2781] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:25.721647 29915 raft_consensus.cc:482] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:25.721673 29915 raft_consensus.cc:3037] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.722781 29915 raft_consensus.cc:504] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.722914 29915 leader_election.cc:288] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 election: Requested vote from peers 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607), 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499)
I20260811 00:50:25.723093 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa7d5173a484a40856aa474f534991f" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
I20260811 00:50:25.723098 29276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfa7d5173a484a40856aa474f534991f" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d4ce613343c43a6aec36d779d48eca6"
I20260811 00:50:25.723160 29782 raft_consensus.cc:3037] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.723163 29276 raft_consensus.cc:3037] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:25.723801 29782 raft_consensus.cc:2454] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 1.
I20260811 00:50:25.723901 29276 raft_consensus.cc:2454] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 1.
I20260811 00:50:25.723950 29397 leader_election.cc:302] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6906bac28ab34a74ab7adb2cd1f758a7, 9051d1d568044b87a4eac3e01f03bb48; no voters:
I20260811 00:50:25.724067 29915 raft_consensus.cc:2781] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:25.724217 29915 raft_consensus.cc:686] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 1 LEADER]: Becoming Leader. State: Replica: 9051d1d568044b87a4eac3e01f03bb48, State: Running, Role: LEADER
I20260811 00:50:25.724289 29915 consensus_queue.cc:237] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.725003 28992 catalog_manager.cc:5495] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } health_report { overall_health: UNKNOWN } } }
W20260811 00:50:25.728878 29353 tablet.cc:2369] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 00:50:25 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409424, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:25.760602 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.753109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.26.99.190:34719)
0811 00:50:25.753160 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:25.753163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:25.753270 (+ 107us) server_negotiation.cc:407] Connection header received
0811 00:50:25.753345 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:25.753346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:25.753355 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:25.753425 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:25.754034 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.754548 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.755560 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.755781 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.755835 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.758219 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:25.758220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:25.758220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:25.758226 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:25.759418 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.759864 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.759865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.759865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.759924 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:25.760125 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:25.760125 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:25.760126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:25.760228 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:25.760273 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:25.760461 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 00:50:25.760537 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:25.760733 29974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:25.753034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34719 (local address 127.0.0.1:44652)
0811 00:50:25.753192 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:25.753204 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:25.753283 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:25.753427 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:25.753428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:25.753855 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:25.753927 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.753930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.754631 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.754632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.755475 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:25.755477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:25.755852 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:25.755853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:25.755915 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:25.756547 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:25.756552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:25.758128 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:25.759499 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.759507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.759509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.759774 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.759992 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:25.759993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:25.759993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:25.760062 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:25.760280 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:25.760288 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:25.760363 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 00:50:25.760443 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:50:25.760613 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":52,"thread_start_us":72,"threads_started":1}
I20260811 00:50:25.763157 28992 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44652:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:50:25.763461 28992 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:25.765056 29492 tablet_service.cc:1467] Processing CreateTablet for tablet 5d2baaf264a04311936e64757c33c914 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02caebc31954054a3a15436a91e91c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:25.765297 29492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d2baaf264a04311936e64757c33c914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.765452 29238 tablet_service.cc:1467] Processing CreateTablet for tablet 5d2baaf264a04311936e64757c33c914 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02caebc31954054a3a15436a91e91c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:25.765520 29736 tablet_service.cc:1467] Processing CreateTablet for tablet 5d2baaf264a04311936e64757c33c914 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e02caebc31954054a3a15436a91e91c3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:25.765600 29238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d2baaf264a04311936e64757c33c914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.765646 29736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d2baaf264a04311936e64757c33c914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:25.767061 29911 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: Bootstrap starting.
I20260811 00:50:25.767072 29909 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: Bootstrap starting.
I20260811 00:50:25.767515 29911 tablet_bootstrap.cc:654] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.767527 29909 tablet_bootstrap.cc:654] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.767946 29908 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: Bootstrap starting.
I20260811 00:50:25.768235 29909 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: No bootstrap required, opened a new log
I20260811 00:50:25.768285 29909 ts_tablet_manager.cc:1397] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:25.768455 29908 tablet_bootstrap.cc:654] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:25.768446 29909 raft_consensus.cc:348] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.768498 29909 raft_consensus.cc:374] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.768510 29909 raft_consensus.cc:729] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6906bac28ab34a74ab7adb2cd1f758a7, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.768546 29909 consensus_queue.cc:260] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.768625 29909 ts_tablet_manager.cc:1428] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.768666 29918 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:25.768745 29918 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:25.769008 29911 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: No bootstrap required, opened a new log
I20260811 00:50:25.769065 29911 ts_tablet_manager.cc:1397] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:50:25.769222 29911 raft_consensus.cc:348] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.769295 29911 raft_consensus.cc:374] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.769322 29911 raft_consensus.cc:729] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9051d1d568044b87a4eac3e01f03bb48, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.769371 29911 consensus_queue.cc:260] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.769461 29911 ts_tablet_manager.cc:1428] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:25.769505 29915 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:25.769587 29915 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:25.770062 29908 tablet_bootstrap.cc:492] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: No bootstrap required, opened a new log
I20260811 00:50:25.770114 29908 ts_tablet_manager.cc:1397] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:50:25.770256 29908 raft_consensus.cc:348] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.770321 29908 raft_consensus.cc:374] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:25.770341 29908 raft_consensus.cc:729] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d4ce613343c43a6aec36d779d48eca6, State: Initialized, Role: FOLLOWER
I20260811 00:50:25.770395 29908 consensus_queue.cc:260] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:25.770493 29908 ts_tablet_manager.cc:1428] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:25.770506 29916 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:25.770576 29916 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 00:50:25.804144 29862 tablet.cc:2369] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:26.010908 29915 raft_consensus.cc:482] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:26.011014 29915 raft_consensus.cc:504] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:26.011183 29915 leader_election.cc:288] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607), 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499)
I20260811 00:50:26.011426 29276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d2baaf264a04311936e64757c33c914" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d4ce613343c43a6aec36d779d48eca6" is_pre_election: true
I20260811 00:50:26.011480 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d2baaf264a04311936e64757c33c914" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" is_pre_election: true
I20260811 00:50:26.011547 29276 raft_consensus.cc:2454] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 0.
I20260811 00:50:26.011572 29782 raft_consensus.cc:2454] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 0.
I20260811 00:50:26.011716 29397 leader_election.cc:302] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9051d1d568044b87a4eac3e01f03bb48, 9d4ce613343c43a6aec36d779d48eca6; no voters:
I20260811 00:50:26.011842 29915 raft_consensus.cc:2781] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:26.011881 29915 raft_consensus.cc:482] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:26.011900 29915 raft_consensus.cc:3037] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:26.012614 29915 raft_consensus.cc:504] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:26.012730 29915 leader_election.cc:288] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 election: Requested vote from peers 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607), 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499)
I20260811 00:50:26.012933 29276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d2baaf264a04311936e64757c33c914" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d4ce613343c43a6aec36d779d48eca6"
I20260811 00:50:26.012974 29782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d2baaf264a04311936e64757c33c914" candidate_uuid: "9051d1d568044b87a4eac3e01f03bb48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6906bac28ab34a74ab7adb2cd1f758a7"
I20260811 00:50:26.013021 29276 raft_consensus.cc:3037] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:26.013059 29782 raft_consensus.cc:3037] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:26.013669 29276 raft_consensus.cc:2454] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 1.
I20260811 00:50:26.013767 29782 raft_consensus.cc:2454] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9051d1d568044b87a4eac3e01f03bb48 in term 1.
I20260811 00:50:26.013922 29397 leader_election.cc:302] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9051d1d568044b87a4eac3e01f03bb48, 9d4ce613343c43a6aec36d779d48eca6; no voters:
I20260811 00:50:26.014031 29915 raft_consensus.cc:2781] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:26.014104 29915 raft_consensus.cc:686] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [term 1 LEADER]: Becoming Leader. State: Replica: 9051d1d568044b87a4eac3e01f03bb48, State: Running, Role: LEADER
I20260811 00:50:26.014158 29915 consensus_queue.cc:237] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } }
I20260811 00:50:26.014437 29964 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: TxnStatusTablet state changed. Reason: New leader 9051d1d568044b87a4eac3e01f03bb48. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.014532 29964 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:26.014743 29982 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:50:26.014773 28993 catalog_manager.cc:5495] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:26.014889 29982 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:50:26.053508 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.051148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32808 (local address 127.26.99.130:37291)
0811 00:50:26.051209 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:26.051211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:26.051220 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:26.051305 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:26.051306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:26.051325 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:26.051379 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:26.051494 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.051981 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.052769 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.052964 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.053021 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.053194 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:26.053295 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:26.053356 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:26.053406 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 00:50:26.053429 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:50:26.053520 29974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.051079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:37291 (local address 127.0.0.1:32808)
0811 00:50:26.051165 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:26.051176 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:26.051225 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:26.051389 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:26.051390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:26.051391 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:26.051444 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:26.051446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.052055 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.052056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:26.052696 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:26.052699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.053024 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.053025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:26.053098 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.053114 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:26.053351 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:26.053359 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 00:50:26.053403 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:26.053453 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 00:50:26.054947 29782 raft_consensus.cc:1261] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Refusing update from remote peer 9051d1d568044b87a4eac3e01f03bb48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:26.055022 29276 raft_consensus.cc:1261] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Refusing update from remote peer 9051d1d568044b87a4eac3e01f03bb48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:26.055226 29915 consensus_queue.cc:1035] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:26.055361 29964 consensus_queue.cc:1035] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:26.055976 29918 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: TxnStatusTablet state changed. Reason: New leader 9051d1d568044b87a4eac3e01f03bb48. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.056113 29918 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:26.056072 29916 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: TxnStatusTablet state changed. Reason: New leader 9051d1d568044b87a4eac3e01f03bb48. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.056174 29916 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:26.056761 29915 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.056838 29915 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:26.056905 29938 mvcc.cc:205] Tried to move back new op lower bound from 7317133009118855168 to 7317133008954400768. Current Snapshot: MvccSnapshot[applied={T|T < 7317133009118855168}]
I20260811 00:50:26.057538 29964 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.057610 29964 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9051d1d568044b87a4eac3e01f03bb48: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:26.057679 29918 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.057751 29918 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 6906bac28ab34a74ab7adb2cd1f758a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:26.058512 29925 mvcc.cc:205] Tried to move back new op lower bound from 7317133009118855168 to 7317133008954400768. Current Snapshot: MvccSnapshot[applied={T|T < 7317133009118855168 or (T in {7317133009118855168})}]
I20260811 00:50:26.058631 29916 tablet_replica.cc:439] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9051d1d568044b87a4eac3e01f03bb48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 } } peers { permanent_uuid: "9051d1d568044b87a4eac3e01f03bb48" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 37291 } } peers { permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 } } }
I20260811 00:50:26.058701 29916 tablet_replica.cc:442] T 5d2baaf264a04311936e64757c33c914 P 9d4ce613343c43a6aec36d779d48eca6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:26.061849 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.059747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.26.99.130:37291)
0811 00:50:26.059793 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:26.059794 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:26.059801 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:26.059820 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:26.059821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:26.059830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:26.059871 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:26.059986 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.060481 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.061249 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.061449 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.061523 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.061646 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:26.061677 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:26.061722 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:26.061771 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 00:50:26.061789 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:26.066846 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.064237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47233 (local address 127.26.99.130:37291)
0811 00:50:26.064269 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:26.064271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:26.064422 (+ 151us) server_negotiation.cc:407] Connection header received
0811 00:50:26.064480 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:26.064480 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:26.064488 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:26.064530 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:26.064668 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.065080 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.066220 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.066392 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.066444 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.066657 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:26.066680 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:26.066725 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:26.066786 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 00:50:26.066803 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":16}
I20260811 00:50:26.066939 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.064193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:37291 (local address 127.26.99.130:47233)
0811 00:50:26.064362 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:26.064372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:26.064428 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:26.064535 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:26.064536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:26.064537 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:26.064616 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:26.064617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.065142 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.065143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:26.066130 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:26.066133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.066477 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.066478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:26.066570 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.066586 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:26.066735 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:26.066737 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:50:26.066784 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:26.066830 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 00:50:26.068938 29782 raft_consensus.cc:1261] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Refusing update from remote peer 9051d1d568044b87a4eac3e01f03bb48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:26.068938 29276 raft_consensus.cc:1261] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Refusing update from remote peer 9051d1d568044b87a4eac3e01f03bb48: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:26.069147 29964 consensus_queue.cc:1035] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d4ce613343c43a6aec36d779d48eca6" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:26.069245 29915 consensus_queue.cc:1035] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6906bac28ab34a74ab7adb2cd1f758a7" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:26.081750 28992 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:26.081861 28992 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:26.082487 28992 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ad052e5f2434aeb9af3816ed84a8e78: Sending DeleteTablet for 3 replicas of tablet bfa7d5173a484a40856aa474f534991f
I20260811 00:50:26.082739 29491 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa7d5173a484a40856aa474f534991f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:26 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:32802
I20260811 00:50:26.082836 29947 tablet_replica.cc:330] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: stopping tablet replica
I20260811 00:50:26.082827 29736 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa7d5173a484a40856aa474f534991f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:26 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:37594
I20260811 00:50:26.082878 29947 raft_consensus.cc:2229] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:26.082919 29946 tablet_replica.cc:330] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: stopping tablet replica
I20260811 00:50:26.082957 29947 raft_consensus.cc:2258] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:26.082984 29946 raft_consensus.cc:2229] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:26.083022 29946 raft_consensus.cc:2258] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:26.083038 29238 tablet_service.cc:1514] Processing DeleteTablet for tablet bfa7d5173a484a40856aa474f534991f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:26 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:59324
I20260811 00:50:26.083184 29949 tablet_replica.cc:330] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: stopping tablet replica
I20260811 00:50:26.083237 29949 raft_consensus.cc:2229] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:26.083267 29949 raft_consensus.cc:2258] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:26.083281 29946 ts_tablet_manager.cc:1905] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:26.083544 29947 ts_tablet_manager.cc:1905] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:26.084970 29946 ts_tablet_manager.cc:1918] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:26.084970 29947 ts_tablet_manager.cc:1918] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:26.085034 29947 log.cc:1196] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/bfa7d5173a484a40856aa474f534991f
I20260811 00:50:26.085034 29946 log.cc:1196] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/bfa7d5173a484a40856aa474f534991f
I20260811 00:50:26.085237 29946 ts_tablet_manager.cc:1939] T bfa7d5173a484a40856aa474f534991f P 6906bac28ab34a74ab7adb2cd1f758a7: Deleting consensus metadata
I20260811 00:50:26.085237 29947 ts_tablet_manager.cc:1939] T bfa7d5173a484a40856aa474f534991f P 9051d1d568044b87a4eac3e01f03bb48: Deleting consensus metadata
I20260811 00:50:26.085462 29949 ts_tablet_manager.cc:1905] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:26.085729 28972 catalog_manager.cc:4841] TS 9051d1d568044b87a4eac3e01f03bb48 (127.26.99.130:37291): tablet bfa7d5173a484a40856aa474f534991f (table test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]) successfully deleted
I20260811 00:50:26.085815 28969 catalog_manager.cc:4841] TS 6906bac28ab34a74ab7adb2cd1f758a7 (127.26.99.131:39499): tablet bfa7d5173a484a40856aa474f534991f (table test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]) successfully deleted
I20260811 00:50:26.086855 29949 ts_tablet_manager.cc:1918] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:26.086922 29949 log.cc:1196] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/bfa7d5173a484a40856aa474f534991f
I20260811 00:50:26.087131 29949 ts_tablet_manager.cc:1939] T bfa7d5173a484a40856aa474f534991f P 9d4ce613343c43a6aec36d779d48eca6: Deleting consensus metadata
I20260811 00:50:26.087468 28969 catalog_manager.cc:4841] TS 9d4ce613343c43a6aec36d779d48eca6 (127.26.99.129:46607): tablet bfa7d5173a484a40856aa474f534991f (table test-table [id=d6c0a239c2784fb5961d0419ae8e76f9]) successfully deleted
Aug 11 00:50:26 dist-test-slave-xt4k krb5kdc[28915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:26.095994 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.087422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59348 (local address 127.26.99.129:46607)
0811 00:50:26.087581 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:26.087584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:26.087593 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:26.087658 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:26.087658 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:26.087669 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:26.087726 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:26.088230 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.089022 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.089737 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.090028 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.090110 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.093268 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:26.093276 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:26.093276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:26.093283 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:26.094880 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:26.095270 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:26.095273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:26.095273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:26.095330 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:26.095515 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:26.095515 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:26.095516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:26.095646 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:26.095756 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:26.095867 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:50:26.095930 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
W20260811 00:50:26.096474 29344 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59348
I20260811 00:50:26.102943 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:26.097483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44666 (local address 127.26.99.190:34719)
0811 00:50:26.097528 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:26.097531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:26.097584 (+ 53us) server_negotiation.cc:407] Connection header received
0811 00:50:26.097645 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:26.097646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:26.097657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:26.097701 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:26.098166 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.098699 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.099351 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:26.099555 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:26.099616 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:26.100702 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:26.100703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:26.100704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:26.100711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:26.101947 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:26.102244 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:26.102245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:26.102246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:26.102297 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:26.102465 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:26.102466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:26.102466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:26.102581 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:26.102669 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:26.102774 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 00:50:26.102854 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 00:50:26.103188 28992 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44666
I20260811 00:50:26.104000 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29116
I20260811 00:50:26.124071 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29364
I20260811 00:50:26.140507 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29614
I20260811 00:50:26.152460 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28935
2026-08-11T00:50:26Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2554 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:26 dist-test-slave-xt4k krb5kdc[30012](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:26 dist-test-slave-xt4k krb5kdc[30012](info): set up 2 sockets
Aug 11 00:50:26 dist-test-slave-xt4k krb5kdc[30012](info): commencing operation
krb5kdc: starting...
W20260811 00:50:27.344177 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:27.465368 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37397
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:27.545857 30038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:27.546063 30038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:27.546084 30038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:27.547164 30038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:27.547197 30038 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:50:27.547209 30038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:27.547221 30038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:27.547231 30038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:27.547242 30038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:27.548702 30038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37397
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:27.548894 30038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:27.549073 30038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:27.553764 30038 server_base.cc:1034] running on GCE node
W20260811 00:50:27.553804 30046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.553718 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.553731 30049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:27.554204 30038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:27.554478 30038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:27.555639 30038 hybrid_clock.cc:648] HybridClock initialized: now 1786409427555628 us; error 37 us; skew 500 ppm
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:27.557973 30038 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:27.558420 30038 webserver.cc:460] Webserver started at http://127.26.99.190:43365/ using document root <none> and password file <none>
I20260811 00:50:27.558598 30038 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:27.558636 30038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:27.558727 30038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:27.559816 30038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "6015b6cc669448869b38a9aeec1355c3"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3ba542f5962d3469674e8c5f5df9190e"
server_key_iv: "7974c06f323cd3307f08747a3355d077"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.560168 30038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "6015b6cc669448869b38a9aeec1355c3"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3ba542f5962d3469674e8c5f5df9190e"
server_key_iv: "7974c06f323cd3307f08747a3355d077"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.561543 30038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:27.562192 30066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:27.562325 30038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:27.562438 30038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "6015b6cc669448869b38a9aeec1355c3"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3ba542f5962d3469674e8c5f5df9190e"
server_key_iv: "7974c06f323cd3307f08747a3355d077"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.562501 30038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:27.573014 30038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:27.575750 30038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:27.575884 30038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:27.580634 30038 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37397
I20260811 00:50:27.580698 30183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37397 every 8 connection(s)
I20260811 00:50:27.581091 30038 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:27.581756 30186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:27.584004 30186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Bootstrap starting.
I20260811 00:50:27.584586 30186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:27.584842 30186 log.cc:824] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:27.585465 30186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: No bootstrap required, opened a new log
I20260811 00:50:27.587435 30186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } }
I20260811 00:50:27.587566 30186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:27.587598 30186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6015b6cc669448869b38a9aeec1355c3, State: Initialized, Role: FOLLOWER
I20260811 00:50:27.587721 30186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } }
I20260811 00:50:27.587783 30186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:27.587813 30186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:27.587857 30186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:27.588474 30186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } }
I20260811 00:50:27.588569 30186 leader_election.cc:302] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6015b6cc669448869b38a9aeec1355c3; no voters:
I20260811 00:50:27.588719 30186 leader_election.cc:288] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:27.588752 30190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:27.588901 30190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [term 1 LEADER]: Becoming Leader. State: Replica: 6015b6cc669448869b38a9aeec1355c3, State: Running, Role: LEADER
I20260811 00:50:27.588959 30186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:27.588992 30190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } }
I20260811 00:50:27.589365 30193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6015b6cc669448869b38a9aeec1355c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } } }
I20260811 00:50:27.589383 30194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6015b6cc669448869b38a9aeec1355c3. Latest consensus state: current_term: 1 leader_uuid: "6015b6cc669448869b38a9aeec1355c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6015b6cc669448869b38a9aeec1355c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37397 } } }
I20260811 00:50:27.589473 30193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:27.589476 30194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:27.589709 30207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:27.589926 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30038
I20260811 00:50:27.590013 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:27.590188 27022 external_mini_cluster.cc:1428] Setting key 118f68dfbc071e434d64a67577d33324
I20260811 00:50:27.590847 30207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:27.592288 30207 catalog_manager.cc:1347] Generated new cluster ID: 41a6e82ddda14756aa96993e54d4e9b1
I20260811 00:50:27.592358 30207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:27.602397 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.590819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57304 (local address 127.26.99.190:37397)
0811 00:50:27.591008 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:27.591017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:27.591876 (+ 859us) server_negotiation.cc:407] Connection header received
0811 00:50:27.592003 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:27.592010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:27.592067 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:27.592258 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:27.592964 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.594325 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.595412 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.596007 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.596096 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.598795 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:27.598799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:27.598799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:27.598812 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:27.600812 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.601176 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.601179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.601180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.601280 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.601451 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.601452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.601452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.601754 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:27.601935 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:27.602003 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 00:50:27.602146 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260811 00:50:27.609925 30207 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:27.610411 30207 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:27.618854 30207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Generated new TSK 0
I20260811 00:50:27.619010 30207 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:27.646689 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37397
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:27.728946 30230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:27.729152 30230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:27.729177 30230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:27.730278 30230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:27.730312 30230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:27.730331 30230 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:50:27.730347 30230 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:27.730363 30230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:27.731824 30230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:37397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:27.732012 30230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:27.732196 30230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:27.737021 30242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.737038 30250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.737200 30244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:27.737280 30230 server_base.cc:1034] running on GCE node
I20260811 00:50:27.737450 30230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:27.737696 30230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:27.738838 30230 hybrid_clock.cc:648] HybridClock initialized: now 1786409427738827 us; error 30 us; skew 500 ppm
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:27.746233 30230 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:27.746691 30230 webserver.cc:460] Webserver started at http://127.26.99.129:46485/ using document root <none> and password file <none>
I20260811 00:50:27.746922 30230 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:27.746970 30230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:27.747102 30230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:27.748148 30230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "5d201f89c4c749ffa84987ee7cb38213"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3cf400178ceee5fec4d87e16fffee5d8"
server_key_iv: "738f87c517a5be52bdf9d0cea05adfe0"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.748509 30230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "5d201f89c4c749ffa84987ee7cb38213"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3cf400178ceee5fec4d87e16fffee5d8"
server_key_iv: "738f87c517a5be52bdf9d0cea05adfe0"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.749754 30230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:27.750448 30260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:27.750610 30230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:27.750687 30230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "5d201f89c4c749ffa84987ee7cb38213"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "3cf400178ceee5fec4d87e16fffee5d8"
server_key_iv: "738f87c517a5be52bdf9d0cea05adfe0"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.750756 30230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:27.759090 30230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:27.760828 30230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:27.760948 30230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:27.761440 30230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:27.761480 30230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:27.761507 30230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:27.761530 30230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:27.768018 30230 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36321
I20260811 00:50:27.768091 30498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36321 every 8 connection(s)
I20260811 00:50:27.768472 30230 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:27.770689 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.761863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:36445 (local address 127.26.99.190:37397)
0811 00:50:27.761927 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:27.761930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:27.762096 (+ 166us) server_negotiation.cc:407] Connection header received
0811 00:50:27.762570 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:27.762571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:27.762585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:27.762663 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:27.763419 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.764191 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.765539 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.765823 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.765891 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.768390 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:27.768392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:27.768392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:27.768400 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:27.769665 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.769996 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.769997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.769997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.770043 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.770219 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.770220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.770220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.770317 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:27.770360 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:27.770559 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 00:50:27.770625 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:27.770828 30279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.761815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.129:36445)
0811 00:50:27.761976 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:27.762014 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:27.762483 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:27.762739 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:27.762743 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:27.763037 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:27.763316 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.763322 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.764290 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.764291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.765450 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.765454 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.765916 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.765917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.766056 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.766539 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:27.766547 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:27.768268 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:27.769734 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.769738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.769740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.769939 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.770091 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.770091 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.770092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.770178 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.770357 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:27.770360 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:27.770467 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 00:50:27.770540 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:50:27.770657 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260811 00:50:27.771283 30500 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37397
I20260811 00:50:27.771384 30500 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:27.771566 30500 heartbeater.cc:511] Master 127.26.99.190:37397 requested a full tablet report, sending...
I20260811 00:50:27.771613 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30230
I20260811 00:50:27.771700 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:27.771881 27022 external_mini_cluster.cc:1428] Setting key 16de2a3da6c4cfd4eef2543cd5d4cff2
I20260811 00:50:27.772118 30092 ts_manager.cc:194] Registered new tserver with Master: 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321)
I20260811 00:50:27.772845 30092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:36445
I20260811 00:50:27.778627 30508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.773464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.129:55477)
0811 00:50:27.773616 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:27.773625 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:27.773676 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:27.773785 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:27.773786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:27.773953 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:27.774014 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.774016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.774681 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.774682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.775371 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.775373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.775682 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.775684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.775757 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.776112 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:27.776117 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:27.776415 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:27.777729 (+ 1314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.777730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.777731 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.777891 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.778060 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.778061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.778061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.778125 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.778328 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:27.778328 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:27.778374 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 00:50:27.778435 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:50:27.778537 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":63,"threads_started":1}
I20260811 00:50:27.778645 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.773516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:55477 (local address 127.26.99.190:37397)
0811 00:50:27.773552 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:27.773554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:27.773678 (+ 124us) server_negotiation.cc:407] Connection header received
0811 00:50:27.773728 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:27.773729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:27.773739 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:27.773782 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:27.774101 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.774593 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.775430 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.775614 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.775665 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.776486 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:27.776488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:27.776488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:27.776495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:27.777657 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.777952 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.777953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.777953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.778007 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.778173 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.778174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.778174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.778275 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:27.778328 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:27.778462 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 00:50:27.778535 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:27.796325 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37397
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:27.875679 30513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:27.875877 30513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:27.875914 30513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:27.877102 30513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:27.877141 30513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:27.877169 30513 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:50:27.877184 30513 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:27.877208 30513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:27.878665 30513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:37397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:27.878886 30513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:27.879089 30513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:27.883858 30523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.883904 30521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:27.883858 30520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:27.884030 30513 server_base.cc:1034] running on GCE node
I20260811 00:50:27.884259 30513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:27.884519 30513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:27.885677 30513 hybrid_clock.cc:648] HybridClock initialized: now 1786409427885660 us; error 24 us; skew 500 ppm
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:27.888074 30513 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:27.888571 30513 webserver.cc:460] Webserver started at http://127.26.99.130:45113/ using document root <none> and password file <none>
I20260811 00:50:27.888777 30513 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:27.888823 30513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:27.888952 30513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:27.890020 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "dd178bdff6794f98b3edeecd24017e6d"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "cc70565c9b780b2e94bdacab3227a9cf"
server_key_iv: "1c883a1dab5b59adfc70a5c10f6d2500"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.890358 30513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "dd178bdff6794f98b3edeecd24017e6d"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "cc70565c9b780b2e94bdacab3227a9cf"
server_key_iv: "1c883a1dab5b59adfc70a5c10f6d2500"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.891577 30513 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:27.892297 30534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:27.892509 30513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:27.892602 30513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "dd178bdff6794f98b3edeecd24017e6d"
format_stamp: "Formatted at 2026-08-11 00:50:27 on dist-test-slave-xt4k"
server_key: "cc70565c9b780b2e94bdacab3227a9cf"
server_key_iv: "1c883a1dab5b59adfc70a5c10f6d2500"
server_key_version: "encryptionkey@0"
I20260811 00:50:27.892673 30513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:27.933012 30513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:27.935025 30513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:27.935168 30513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:27.935725 30513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:27.935765 30513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:27.935796 30513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:27.935812 30513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:27 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:27.942636 30513 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:34149
I20260811 00:50:27.942782 30754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:34149 every 8 connection(s)
I20260811 00:50:27.943013 30513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:27.944675 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.936141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:34789 (local address 127.26.99.190:37397)
0811 00:50:27.936181 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:27.936183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:27.936449 (+ 266us) server_negotiation.cc:407] Connection header received
0811 00:50:27.936953 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:27.936954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:27.936967 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:27.937027 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:27.937656 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.938222 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.939203 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.939400 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.939463 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.941955 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:27.941957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:27.941957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:27.941966 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:27.943356 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.943747 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.943748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.943749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.943808 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.944022 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.944023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.944023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.944137 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:27.944192 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:27.944506 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 00:50:27.944587 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:50:27.944831 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.936148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.130:34789)
0811 00:50:27.936292 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:27.936327 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:27.936853 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:27.937097 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:27.937101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:27.937382 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:27.937569 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.937574 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.938297 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.938299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.939120 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.939123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.939478 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.939478 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.939614 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.940062 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:27.940072 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:27.941867 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:27.943432 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.943437 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.943439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.943682 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.943860 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.943861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.943861 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.943966 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.944189 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:27.944196 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:27.944326 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 00:50:27.944474 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 00:50:27.944629 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":85,"threads_started":1}
I20260811 00:50:27.945338 30756 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37397
I20260811 00:50:27.945425 30756 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:27.945614 30756 heartbeater.cc:511] Master 127.26.99.190:37397 requested a full tablet report, sending...
I20260811 00:50:27.945956 30093 ts_manager.cc:194] Registered new tserver with Master: dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149)
I20260811 00:50:27.946393 30093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:34789
I20260811 00:50:27.951164 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.946468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:33235 (local address 127.26.99.190:37397)
0811 00:50:27.946502 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:27.946504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:27.946607 (+ 103us) server_negotiation.cc:407] Connection header received
0811 00:50:27.946653 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:27.946653 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:27.946663 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:27.946714 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:27.947113 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.947560 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.948229 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.948488 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.948542 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.949290 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:27.949291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:27.949291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:27.949298 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:27.950341 (+ 1043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.950624 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.950625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.950625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.950665 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:27.950787 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:27.950787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:27.950787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:27.950909 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:27.950953 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:27.951046 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 00:50:27.951107 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:50:27.951165 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:27.946411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.130:33235)
0811 00:50:27.946551 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:27.946560 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:27.946616 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:27.946735 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:27.946736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:27.946973 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:27.947037 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.947039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.947641 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.947642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.948145 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:27.948147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:27.948566 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:27.948567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:27.948633 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:27.948971 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:27.948975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:27.949221 (+ 246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:27.950412 (+ 1191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.950413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.950413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.950570 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.950706 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:27.950707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:27.950707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:27.950755 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:27.950950 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:27.950951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:27.950984 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 00:50:27.951025 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 00:50:27.951098 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260811 00:50:27.951514 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30513
I20260811 00:50:27.951611 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:27.951766 27022 external_mini_cluster.cc:1428] Setting key e65a7c76b1522104be978681180d83e5
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:27.974694 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37397
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:28.055143 30773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:28.055346 30773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:28.055369 30773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:28.056484 30773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:28.056524 30773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:28.056542 30773 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 00:50:28.056552 30773 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:28.056591 30773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:28.057994 30773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:37397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:28.058171 30773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:28.058349 30773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:28.063108 30791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:28.063112 30788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:28.063114 30781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:28.063316 30773 server_base.cc:1034] running on GCE node
I20260811 00:50:28.063510 30773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:28.063758 30773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:28.064894 30773 hybrid_clock.cc:648] HybridClock initialized: now 1786409428064880 us; error 33 us; skew 500 ppm
Aug 11 00:50:28 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409428, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:28.067242 30773 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:28.067754 30773 webserver.cc:460] Webserver started at http://127.26.99.131:33855/ using document root <none> and password file <none>
I20260811 00:50:28.067951 30773 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:28.067996 30773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:28.068116 30773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:28.069175 30773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "911b6cb2ec4d4b45996cfebff050714f"
format_stamp: "Formatted at 2026-08-11 00:50:28 on dist-test-slave-xt4k"
server_key: "9f52f7073cdced953e27e4601824ce46"
server_key_iv: "0b9bea0e5c992ec4edad480af9e35360"
server_key_version: "encryptionkey@0"
I20260811 00:50:28.069502 30773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "911b6cb2ec4d4b45996cfebff050714f"
format_stamp: "Formatted at 2026-08-11 00:50:28 on dist-test-slave-xt4k"
server_key: "9f52f7073cdced953e27e4601824ce46"
server_key_iv: "0b9bea0e5c992ec4edad480af9e35360"
server_key_version: "encryptionkey@0"
I20260811 00:50:28.070916 30773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:50:28.071571 30807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:28.071724 30773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:28.071805 30773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "911b6cb2ec4d4b45996cfebff050714f"
format_stamp: "Formatted at 2026-08-11 00:50:28 on dist-test-slave-xt4k"
server_key: "9f52f7073cdced953e27e4601824ce46"
server_key_iv: "0b9bea0e5c992ec4edad480af9e35360"
server_key_version: "encryptionkey@0"
I20260811 00:50:28.071871 30773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:28.083823 30773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:28.085974 30773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:28.086104 30773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:28.086720 30773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:28.086771 30773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:28.086799 30773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:28.086815 30773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 00:50:28 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409428, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:28.093991 30773 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38713
I20260811 00:50:28.094049 31024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38713 every 8 connection(s)
I20260811 00:50:28.094406 30773 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:28.096618 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.087111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:56551 (local address 127.26.99.190:37397)
0811 00:50:28.087172 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.087174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.087387 (+ 213us) server_negotiation.cc:407] Connection header received
0811 00:50:28.087906 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.087907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.087920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.087973 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:28.088718 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.089331 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.090890 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.091199 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.091279 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.093578 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:28.093580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:28.093580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:28.093588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:28.095186 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.095664 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.095665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.095666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.095724 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.095986 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.095986 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.095987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.096117 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:28.096166 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.096484 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.096553 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:50:28.096817 30827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.087099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.131:56551)
0811 00:50:28.087264 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.087304 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.087809 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.088039 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.088044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.088329 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:28.088633 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.088639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.089511 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.089512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.090775 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.090779 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.091298 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.091299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.091432 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.092058 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:28.092066 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:28.093487 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:28.095263 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.095269 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.095271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.095589 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.095783 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.095784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.095784 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.095921 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.096204 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:28.096210 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:28.096356 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.096457 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.096602 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260811 00:50:28.097195 31026 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37397
I20260811 00:50:28.097276 31026 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:28.097461 31026 heartbeater.cc:511] Master 127.26.99.190:37397 requested a full tablet report, sending...
I20260811 00:50:28.097856 30092 ts_manager.cc:194] Registered new tserver with Master: 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.098357 30092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:56551
I20260811 00:50:28.099244 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30773
I20260811 00:50:28.099351 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:28.099537 27022 external_mini_cluster.cc:1428] Setting key b578dd2d16f6c7bf140dce4a320ee46c
I20260811 00:50:28.100265 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:28.103915 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.098379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:42383 (local address 127.26.99.190:37397)
0811 00:50:28.098420 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.098421 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.098511 (+ 90us) server_negotiation.cc:407] Connection header received
0811 00:50:28.098568 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.098569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.098588 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.098647 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:28.098997 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.099650 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.100569 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.100850 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.100923 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.101671 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:28.101672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:28.101672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:28.101679 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:28.102959 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.103251 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.103252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.103252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.103304 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.103461 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.103462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.103462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.103561 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:28.103620 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.103753 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.103824 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:28.103931 31041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.098294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.26.99.131:42383)
0811 00:50:28.098430 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.098441 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.098526 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.098650 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.098651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.098868 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:28.098933 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.098935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.099761 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.099762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.100505 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.100507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.100919 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.100919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.100967 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.101329 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:28.101334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:28.101592 (+ 258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:28.103030 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.103031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.103031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.103192 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.103357 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.103357 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.103358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.103413 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.103620 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:28.103621 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:28.103666 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.103724 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.103827 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
Aug 11 00:50:28 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:50:28 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:28.123519 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.117138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.26.99.190:37397)
0811 00:50:28.117198 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.117200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.117210 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:28.117234 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.117235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.117245 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.117298 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:28.117850 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.118357 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.119142 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.119332 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.119390 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.121437 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:28.121439 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:28.121439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:28.121445 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:28.122554 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.122857 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.122858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.122859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.122929 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.123105 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.123106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.123106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.123226 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:28.123310 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.123395 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.123454 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:28.125020 30092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:28.126550 30092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:28.132828 31062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.128642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34149 (local address 127.0.0.1:40700)
0811 00:50:28.128852 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.129065 (+ 213us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.129139 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.129339 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.129340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.129342 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:28.129647 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.129651 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130832 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.130833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.131834 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.131837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132546 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.132547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.132628 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.132642 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.132703 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.132756 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":55,"threads_started":1}
I20260811 00:50:28.132874 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.128745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40700 (local address 127.26.99.130:34149)
0811 00:50:28.129084 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.129090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.129197 (+ 107us) server_negotiation.cc:407] Connection header received
0811 00:50:28.129240 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.129242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.129256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.129324 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:28.129739 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130760 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.131911 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132474 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.132538 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.132612 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.132737 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.132781 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":77,"threads_started":1}
I20260811 00:50:28.133287 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.128707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38713 (local address 127.0.0.1:54220)
0811 00:50:28.128900 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.128932 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.129000 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.129324 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.129326 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.129328 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:28.129395 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.129398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130624 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.130625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.131840 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.131843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132785 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.132786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.132849 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.132853 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.133184 (+ 331us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.133219 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":46,"thread_start_us":79,"threads_started":1}
I20260811 00:50:28.133458 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.129023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55014 (local address 127.26.99.129:36321)
0811 00:50:28.129456 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.129460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.129468 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:28.129506 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.129508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.129522 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.129582 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:28.129698 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130382 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.131944 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132691 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.132756 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.132813 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.133331 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.133369 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":90,"threads_started":1}
I20260811 00:50:28.133287 31068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.128833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.0.0.1:55014)
0811 00:50:28.129100 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.129107 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.129139 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.129593 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.129594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.129596 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:28.129639 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.129641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130457 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.130458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.131853 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.131855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132840 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.132841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.132889 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.132892 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.133157 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.133202 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":76,"thread_start_us":67,"threads_started":1}
I20260811 00:50:28.133504 30637 tablet_service.cc:1467] Processing CreateTablet for tablet cc85401baada4bfe8314809d0e0116a9 (DEFAULT_TABLE table=test-table [id=7dde55ca194f42bba14b79b82e43b20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.133888 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc85401baada4bfe8314809d0e0116a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.133973 31070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.128923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.26.99.131:38713)
0811 00:50:28.129173 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.129177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.129185 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:28.129223 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.129225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.129239 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.129308 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:28.129470 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.130533 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.131942 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.132687 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.133782 (+ 1095us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.133829 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.133849 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.133880 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":84,"threads_started":1}
I20260811 00:50:28.134581 30881 tablet_service.cc:1467] Processing CreateTablet for tablet cc85401baada4bfe8314809d0e0116a9 (DEFAULT_TABLE table=test-table [id=7dde55ca194f42bba14b79b82e43b20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.134925 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc85401baada4bfe8314809d0e0116a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.136984 30365 tablet_service.cc:1467] Processing CreateTablet for tablet cc85401baada4bfe8314809d0e0116a9 (DEFAULT_TABLE table=test-table [id=7dde55ca194f42bba14b79b82e43b20d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.137269 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc85401baada4bfe8314809d0e0116a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.137614 31072 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Bootstrap starting.
I20260811 00:50:28.138058 31073 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Bootstrap starting.
I20260811 00:50:28.138428 31072 tablet_bootstrap.cc:654] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.138779 31072 log.cc:824] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:28.138898 31073 tablet_bootstrap.cc:654] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.139196 31073 log.cc:824] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:28.139544 31072 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: No bootstrap required, opened a new log
I20260811 00:50:28.139632 31072 ts_tablet_manager.cc:1397] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:28.140056 31073 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: No bootstrap required, opened a new log
I20260811 00:50:28.140196 31073 ts_tablet_manager.cc:1397] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:28.140717 31077 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Bootstrap starting.
I20260811 00:50:28.141264 31077 tablet_bootstrap.cc:654] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.141533 31077 log.cc:824] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:28.141553 31072 raft_consensus.cc:348] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.141731 31072 raft_consensus.cc:374] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.141777 31072 raft_consensus.cc:729] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.141898 31072 consensus_queue.cc:260] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.142158 31072 ts_tablet_manager.cc:1428] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:50:28.142181 30756 heartbeater.cc:503] Master 127.26.99.190:37397 was elected leader, sending a full tablet report...
I20260811 00:50:28.142144 31073 raft_consensus.cc:348] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.142293 31073 raft_consensus.cc:374] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.142330 31073 raft_consensus.cc:729] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b6cb2ec4d4b45996cfebff050714f, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.142450 31073 consensus_queue.cc:260] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.142601 31077 tablet_bootstrap.cc:492] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: No bootstrap required, opened a new log
I20260811 00:50:28.142663 31077 ts_tablet_manager.cc:1397] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:28.142824 31026 heartbeater.cc:503] Master 127.26.99.190:37397 was elected leader, sending a full tablet report...
I20260811 00:50:28.142831 31073 ts_tablet_manager.cc:1428] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:50:28.144590 31077 raft_consensus.cc:348] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.144707 31077 raft_consensus.cc:374] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.144738 31077 raft_consensus.cc:729] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.144838 31077 consensus_queue.cc:260] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.145047 31077 ts_tablet_manager.cc:1428] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:28.145100 30500 heartbeater.cc:503] Master 127.26.99.190:37397 was elected leader, sending a full tablet report...
W20260811 00:50:28.193565 30757 tablet.cc:2369] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:28.269305 30501 tablet.cc:2369] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:28.340544 31086 raft_consensus.cc:482] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:28.340687 31086 raft_consensus.cc:504] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.341066 31086 leader_election.cc:288] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.343883 31070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.341375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:47519 (local address 127.26.99.131:38713)
0811 00:50:28.341443 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.341445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.341492 (+ 47us) server_negotiation.cc:407] Connection header received
0811 00:50:28.341576 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.341577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.341586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.341630 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:28.341768 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.342248 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343219 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.343588 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343650 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.343657 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.343778 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.343815 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:50:28.343888 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.341375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:49361 (local address 127.26.99.130:34149)
0811 00:50:28.341441 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.341443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.341540 (+ 97us) server_negotiation.cc:407] Connection header received
0811 00:50:28.341606 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.341607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.341615 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.341661 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:28.341807 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.342273 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343222 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.343583 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343644 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.343653 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.343789 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.343823 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:50:28.343963 31088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.341255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38713 (local address 127.26.99.129:47519)
0811 00:50:28.341411 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.341424 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.341514 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.341639 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.341639 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.341642 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:28.341713 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.341715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.342317 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.342318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.343134 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.343137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.343655 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.343721 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.343725 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.343768 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.343812 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":45,"thread_start_us":83,"threads_started":1}
I20260811 00:50:28.344159 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.341255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34149 (local address 127.26.99.129:49361)
0811 00:50:28.341454 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.341465 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.341541 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.341670 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.341671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.341673 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:28.341747 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.341749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.342341 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.342342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.343131 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.343133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.343651 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.343652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.343726 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.343729 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.343774 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.343815 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":28,"thread_start_us":63,"threads_started":1}
I20260811 00:50:28.344307 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc85401baada4bfe8314809d0e0116a9" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f" is_pre_election: true
I20260811 00:50:28.344488 30940 raft_consensus.cc:2454] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.344529 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc85401baada4bfe8314809d0e0116a9" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d" is_pre_election: true
I20260811 00:50:28.344695 30679 raft_consensus.cc:2454] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.344743 30263 leader_election.cc:302] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:28.344854 31086 raft_consensus.cc:2781] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:28.344909 31086 raft_consensus.cc:482] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:28.344928 31086 raft_consensus.cc:3037] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Advancing to term 1
W20260811 00:50:28.344964 31030 tablet.cc:2369] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:28.345634 31086 raft_consensus.cc:504] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.345760 31086 leader_election.cc:288] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Requested vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.345896 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc85401baada4bfe8314809d0e0116a9" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d"
I20260811 00:50:28.345904 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc85401baada4bfe8314809d0e0116a9" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f"
I20260811 00:50:28.345970 30679 raft_consensus.cc:3037] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.345984 30940 raft_consensus.cc:3037] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.346657 30940 raft_consensus.cc:2454] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.346662 30679 raft_consensus.cc:2454] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.346813 30263 leader_election.cc:302] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:28.346904 31086 raft_consensus.cc:2781] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:28.347062 31086 raft_consensus.cc:686] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Becoming Leader. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Running, Role: LEADER
I20260811 00:50:28.347146 31086 consensus_queue.cc:237] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.347918 30093 catalog_manager.cc:5495] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:50:28 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409427, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:28.383651 31108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.377119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37397 (local address 127.0.0.1:57320)
0811 00:50:28.377332 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.377343 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.377420 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.377567 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.377568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.377891 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:28.377940 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.377943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.378577 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.378578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.379091 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.379092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.379398 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.379398 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.379449 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.379929 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:28.379934 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:28.381238 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:28.382639 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.382646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.382649 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.382832 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.383012 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:28.383013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:28.383013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:28.383072 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:28.383355 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:28.383361 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:28.383403 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.383481 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.383575 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":97,"threads_started":1}
I20260811 00:50:28.383728 30225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.377222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57320 (local address 127.26.99.190:37397)
0811 00:50:28.377323 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.377325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.377410 (+ 85us) server_negotiation.cc:407] Connection header received
0811 00:50:28.377478 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.377479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.377489 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.377537 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:28.378019 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.378508 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.379161 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.379343 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.379396 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.381323 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:28.381325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:28.381325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:28.381332 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:28.382555 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.382896 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.382897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.382897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.382959 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:28.383148 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:28.383149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:28.383150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:28.383297 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:28.383359 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.383505 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.383639 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":64}
I20260811 00:50:28.385552 30093 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:57320:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:50:28.385746 30093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:28.387143 30637 tablet_service.cc:1467] Processing CreateTablet for tablet c57fdbf55b834cc399779dc56a16b180 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a845eea9f5844065bed759e7707844ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:28.387162 30365 tablet_service.cc:1467] Processing CreateTablet for tablet c57fdbf55b834cc399779dc56a16b180 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a845eea9f5844065bed759e7707844ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:28.387164 30881 tablet_service.cc:1467] Processing CreateTablet for tablet c57fdbf55b834cc399779dc56a16b180 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a845eea9f5844065bed759e7707844ee]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:28.387291 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c57fdbf55b834cc399779dc56a16b180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.387319 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c57fdbf55b834cc399779dc56a16b180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.387319 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c57fdbf55b834cc399779dc56a16b180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.388399 31072 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: Bootstrap starting.
I20260811 00:50:28.388849 31077 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: Bootstrap starting.
I20260811 00:50:28.388890 31073 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: Bootstrap starting.
I20260811 00:50:28.389099 31072 tablet_bootstrap.cc:654] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.389285 31077 tablet_bootstrap.cc:654] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.389511 31073 tablet_bootstrap.cc:654] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.389854 31072 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: No bootstrap required, opened a new log
I20260811 00:50:28.389910 31072 ts_tablet_manager.cc:1397] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:28.389995 31077 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: No bootstrap required, opened a new log
I20260811 00:50:28.390049 31077 ts_tablet_manager.cc:1397] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:28.390076 31072 raft_consensus.cc:348] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390169 31072 raft_consensus.cc:374] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.390193 31072 raft_consensus.cc:729] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.390215 31073 tablet_bootstrap.cc:492] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: No bootstrap required, opened a new log
I20260811 00:50:28.390236 31072 consensus_queue.cc:260] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390266 31073 ts_tablet_manager.cc:1397] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:28.390355 31072 ts_tablet_manager.cc:1428] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:28.390412 31073 raft_consensus.cc:348] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390412 31077 raft_consensus.cc:348] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390491 31073 raft_consensus.cc:374] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.390491 31077 raft_consensus.cc:374] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.390512 31077 raft_consensus.cc:729] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.390512 31073 raft_consensus.cc:729] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b6cb2ec4d4b45996cfebff050714f, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.390556 31077 consensus_queue.cc:260] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390558 31073 consensus_queue.cc:260] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.390641 31073 ts_tablet_manager.cc:1428] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:28.390642 31077 ts_tablet_manager.cc:1428] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:28.390789 31086 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.390785 31084 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.390866 31086 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.390866 31084 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.391024 31085 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.391108 31085 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.481168 31086 raft_consensus.cc:482] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:28.481264 31086 raft_consensus.cc:504] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.481405 31086 leader_election.cc:288] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.481607 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c57fdbf55b834cc399779dc56a16b180" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d" is_pre_election: true
I20260811 00:50:28.481617 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c57fdbf55b834cc399779dc56a16b180" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f" is_pre_election: true
I20260811 00:50:28.481701 30940 raft_consensus.cc:2454] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.481707 30679 raft_consensus.cc:2454] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.481837 30263 leader_election.cc:302] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:28.481940 31086 raft_consensus.cc:2781] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:28.481980 31086 raft_consensus.cc:482] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:28.482007 31086 raft_consensus.cc:3037] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.482712 31086 raft_consensus.cc:504] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.482841 31086 leader_election.cc:288] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Requested vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.482996 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c57fdbf55b834cc399779dc56a16b180" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d"
I20260811 00:50:28.483035 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c57fdbf55b834cc399779dc56a16b180" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f"
I20260811 00:50:28.483100 30940 raft_consensus.cc:3037] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.483083 30679 raft_consensus.cc:3037] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.483891 30940 raft_consensus.cc:2454] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.483893 30679 raft_consensus.cc:2454] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.484103 30268 leader_election.cc:302] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, dd178bdff6794f98b3edeecd24017e6d; no voters:
I20260811 00:50:28.484246 31086 raft_consensus.cc:2781] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:28.484308 31086 raft_consensus.cc:686] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Becoming Leader. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Running, Role: LEADER
I20260811 00:50:28.484378 31086 consensus_queue.cc:237] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.484712 31094 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: TxnStatusTablet state changed. Reason: New leader 5d201f89c4c749ffa84987ee7cb38213. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.484819 31094 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:28.485037 31121 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:50:28.485069 30092 catalog_manager.cc:5495] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:28.485179 31121 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:50:28.507876 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.505355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.26.99.129:36321)
0811 00:50:28.505407 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.505409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.505417 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:28.505474 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.505474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.505490 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.505546 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:28.505688 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.506153 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.507206 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.507381 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.507423 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.507607 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:28.507696 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:28.507747 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.507803 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.507819 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:50:28.507932 31108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.505249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.0.0.1:55022)
0811 00:50:28.505324 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.505337 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.505394 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.505567 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.505568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.505569 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:28.505626 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.505629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.506216 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.506217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.507133 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.507137 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.507437 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.507438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.507514 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.507531 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:28.507745 (+ 214us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:28.507750 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.507797 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.507848 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 00:50:28.509671 30940 raft_consensus.cc:1261] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.509672 30679 raft_consensus.cc:1261] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.509994 31094 consensus_queue.cc:1035] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.510147 31086 consensus_queue.cc:1035] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.511376 31084 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: TxnStatusTablet state changed. Reason: New leader 5d201f89c4c749ffa84987ee7cb38213. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.511476 31084 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.511554 31085 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: TxnStatusTablet state changed. Reason: New leader 5d201f89c4c749ffa84987ee7cb38213. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.511677 31085 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.512681 31094 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.512766 31094 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:28.512811 31094 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.512848 31094 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 5d201f89c4c749ffa84987ee7cb38213: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:28.512801 31084 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.512871 31084 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P dd178bdff6794f98b3edeecd24017e6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.512912 31124 mvcc.cc:205] Tried to move back new op lower bound from 7317133019173117952 to 7317133019072417792. Current Snapshot: MvccSnapshot[applied={T|T < 7317133019173117952}]
I20260811 00:50:28.513375 31129 mvcc.cc:205] Tried to move back new op lower bound from 7317133019173117952 to 7317133019072417792. Current Snapshot: MvccSnapshot[applied={T|T < 7317133019173117952}]
I20260811 00:50:28.514034 31085 tablet_replica.cc:439] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } } }
I20260811 00:50:28.514124 31085 tablet_replica.cc:442] T c57fdbf55b834cc399779dc56a16b180 P 911b6cb2ec4d4b45996cfebff050714f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:28.518337 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.516238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55028 (local address 127.26.99.129:36321)
0811 00:50:28.516288 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.516290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.516297 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:28.516316 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.516317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.516326 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.516394 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:28.516523 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.516975 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.517735 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.517938 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.517993 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.518130 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:28.518162 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:28.518206 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.518256 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.518275 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:28.523120 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.520631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:38633 (local address 127.26.99.129:36321)
0811 00:50:28.520668 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:28.520670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:28.520768 (+ 98us) server_negotiation.cc:407] Connection header received
0811 00:50:28.520825 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:28.520826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:28.520832 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:28.520873 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:28.521012 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.521422 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.522530 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.522698 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.522740 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.522939 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:28.522959 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:28.522989 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:28.523042 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 00:50:28.523058 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":21}
I20260811 00:50:28.523360 31147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:28.520562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.26.99.129:38633)
0811 00:50:28.520705 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:28.520715 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:28.520774 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:28.520888 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:28.520889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:28.520890 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:28.520958 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.520960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.521475 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.521475 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.522456 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:28.522459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:28.522768 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:28.522770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:28.522842 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:28.522857 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:28.522993 (+ 136us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:28.522994 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:28.523040 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:28.523086 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260811 00:50:28.525532 30679 raft_consensus.cc:1261] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.525563 30940 raft_consensus.cc:1261] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.525749 31094 consensus_queue.cc:1035] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.525870 31094 consensus_queue.cc:1035] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.536990 30092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:28.537071 30092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:28.537706 30092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Sending DeleteTablet for 3 replicas of tablet cc85401baada4bfe8314809d0e0116a9
I20260811 00:50:28.537964 30881 tablet_service.cc:1514] Processing DeleteTablet for tablet cc85401baada4bfe8314809d0e0116a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:28 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:54220
I20260811 00:50:28.538041 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet cc85401baada4bfe8314809d0e0116a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:28 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:40700
I20260811 00:50:28.538177 30365 tablet_service.cc:1514] Processing DeleteTablet for tablet cc85401baada4bfe8314809d0e0116a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:28 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55014
I20260811 00:50:28.538307 31158 tablet_replica.cc:330] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: stopping tablet replica
I20260811 00:50:28.538390 31159 tablet_replica.cc:330] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: stopping tablet replica
I20260811 00:50:28.538491 31158 raft_consensus.cc:2229] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:28.538498 31159 raft_consensus.cc:2229] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:28.538590 31159 raft_consensus.cc:2258] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:28.538611 30092 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:28.538743 30092 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:28.538980 31158 raft_consensus.cc:2258] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:28.538990 31159 ts_tablet_manager.cc:1905] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:28.539477 31158 ts_tablet_manager.cc:1905] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:28.540226 30881 tablet_service.cc:1467] Processing CreateTablet for tablet 6d84d242911c479c8dd7c004417a71bf (DEFAULT_TABLE table=test-table [id=61bb60097e494a66b4b2be21558daa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.540371 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d84d242911c479c8dd7c004417a71bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.540802 31159 ts_tablet_manager.cc:1918] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:28.540874 31159 log.cc:1196] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/cc85401baada4bfe8314809d0e0116a9
I20260811 00:50:28.541113 31159 ts_tablet_manager.cc:1939] T cc85401baada4bfe8314809d0e0116a9 P 5d201f89c4c749ffa84987ee7cb38213: Deleting consensus metadata
I20260811 00:50:28.541478 31158 ts_tablet_manager.cc:1918] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:28.541622 31158 log.cc:1196] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/cc85401baada4bfe8314809d0e0116a9
I20260811 00:50:28.541864 31073 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Bootstrap starting.
I20260811 00:50:28.541986 31158 ts_tablet_manager.cc:1939] T cc85401baada4bfe8314809d0e0116a9 P dd178bdff6794f98b3edeecd24017e6d: Deleting consensus metadata
I20260811 00:50:28.542062 30074 catalog_manager.cc:4841] TS 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321): tablet cc85401baada4bfe8314809d0e0116a9 (table test-table [id=7dde55ca194f42bba14b79b82e43b20d]) successfully deleted
I20260811 00:50:28.542287 30365 tablet_service.cc:1467] Processing CreateTablet for tablet 6d84d242911c479c8dd7c004417a71bf (DEFAULT_TABLE table=test-table [id=61bb60097e494a66b4b2be21558daa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.542325 31073 tablet_bootstrap.cc:654] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.542410 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d84d242911c479c8dd7c004417a71bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.542697 30637 tablet_service.cc:1467] Processing CreateTablet for tablet 6d84d242911c479c8dd7c004417a71bf (DEFAULT_TABLE table=test-table [id=61bb60097e494a66b4b2be21558daa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:28.542898 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d84d242911c479c8dd7c004417a71bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:28.543001 30074 catalog_manager.cc:4841] TS dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149): tablet cc85401baada4bfe8314809d0e0116a9 (table test-table [id=7dde55ca194f42bba14b79b82e43b20d]) successfully deleted
I20260811 00:50:28.543476 31077 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Bootstrap starting.
I20260811 00:50:28.543581 31157 tablet_replica.cc:330] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: stopping tablet replica
I20260811 00:50:28.543684 31157 raft_consensus.cc:2229] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:28.543731 31157 raft_consensus.cc:2258] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:28.543862 31077 tablet_bootstrap.cc:654] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.544061 31072 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Bootstrap starting.
I20260811 00:50:28.544440 31072 tablet_bootstrap.cc:654] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:28.544529 31157 ts_tablet_manager.cc:1905] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:28.544795 31077 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: No bootstrap required, opened a new log
I20260811 00:50:28.544839 31077 ts_tablet_manager.cc:1397] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:28.544965 31077 raft_consensus.cc:348] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.545020 31077 raft_consensus.cc:374] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.545037 31077 raft_consensus.cc:729] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.545084 31077 consensus_queue.cc:260] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.545189 31077 ts_tablet_manager.cc:1428] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:28.546020 31157 ts_tablet_manager.cc:1918] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:28.546089 31157 log.cc:1196] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/cc85401baada4bfe8314809d0e0116a9
I20260811 00:50:28.546370 31157 ts_tablet_manager.cc:1939] T cc85401baada4bfe8314809d0e0116a9 P 911b6cb2ec4d4b45996cfebff050714f: Deleting consensus metadata
I20260811 00:50:28.546756 30068 catalog_manager.cc:4841] TS 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713): tablet cc85401baada4bfe8314809d0e0116a9 (table test-table [id=7dde55ca194f42bba14b79b82e43b20d]) successfully deleted
I20260811 00:50:28.546975 31072 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: No bootstrap required, opened a new log
I20260811 00:50:28.547042 31072 ts_tablet_manager.cc:1397] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 00:50:28.547216 31072 raft_consensus.cc:348] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.547286 31072 raft_consensus.cc:374] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.547312 31072 raft_consensus.cc:729] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.547355 31072 consensus_queue.cc:260] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.547435 31072 ts_tablet_manager.cc:1428] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:28.548704 31073 tablet_bootstrap.cc:492] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: No bootstrap required, opened a new log
I20260811 00:50:28.548759 31073 ts_tablet_manager.cc:1397] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 00:50:28.548885 31073 raft_consensus.cc:348] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.548954 31073 raft_consensus.cc:374] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:28.548972 31073 raft_consensus.cc:729] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b6cb2ec4d4b45996cfebff050714f, State: Initialized, Role: FOLLOWER
I20260811 00:50:28.549023 31073 consensus_queue.cc:260] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.549113 31073 ts_tablet_manager.cc:1428] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:28.610643 31153 raft_consensus.cc:482] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:28.610757 31153 raft_consensus.cc:504] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.610952 31153 leader_election.cc:288] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.611171 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d84d242911c479c8dd7c004417a71bf" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d" is_pre_election: true
I20260811 00:50:28.611181 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d84d242911c479c8dd7c004417a71bf" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f" is_pre_election: true
I20260811 00:50:28.611276 30940 raft_consensus.cc:2454] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.611275 30679 raft_consensus.cc:2454] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:28.611447 30263 leader_election.cc:302] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:28.611543 31153 raft_consensus.cc:2781] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:28.611584 31153 raft_consensus.cc:482] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:28.611603 31153 raft_consensus.cc:3037] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.612382 31153 raft_consensus.cc:504] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.612540 31153 leader_election.cc:288] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Requested vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:28.612686 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d84d242911c479c8dd7c004417a71bf" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f"
I20260811 00:50:28.612766 30940 raft_consensus.cc:3037] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.612756 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d84d242911c479c8dd7c004417a71bf" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d"
I20260811 00:50:28.612865 30679 raft_consensus.cc:3037] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:28.613392 30940 raft_consensus.cc:2454] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.613555 30263 leader_election.cc:302] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:28.613636 31153 raft_consensus.cc:2781] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:28.613652 30679 raft_consensus.cc:2454] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:28.613677 31153 raft_consensus.cc:686] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Becoming Leader. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Running, Role: LEADER
I20260811 00:50:28.613726 31153 consensus_queue.cc:237] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:28.614310 30092 catalog_manager.cc:5495] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:28.620606 30940 raft_consensus.cc:1261] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.620813 31094 consensus_queue.cc:1035] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.620877 30679 raft_consensus.cc:1261] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:28.621104 31094 consensus_queue.cc:1035] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:28.622213 31127 mvcc.cc:205] Tried to move back new op lower bound from 7317133019628826624 to 7317133019602116608. Current Snapshot: MvccSnapshot[applied={T|T < 7317133019628826624}]
W20260811 00:50:28.625361 31124 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 00:50:30.141976 30093 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:30.142087 30093 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:30.142880 30093 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Sending DeleteTablet for 3 replicas of tablet 6d84d242911c479c8dd7c004417a71bf
I20260811 00:50:30.143087 30365 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d84d242911c479c8dd7c004417a71bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55014
I20260811 00:50:30.143129 30881 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d84d242911c479c8dd7c004417a71bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:54220
I20260811 00:50:30.143285 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d84d242911c479c8dd7c004417a71bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:40700
I20260811 00:50:30.143301 31208 tablet_replica.cc:330] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: stopping tablet replica
I20260811 00:50:30.143378 31208 raft_consensus.cc:2229] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:30.143435 31208 raft_consensus.cc:2258] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.143443 31212 tablet_replica.cc:330] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: stopping tablet replica
I20260811 00:50:30.143491 31212 raft_consensus.cc:2229] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:30.143519 31212 raft_consensus.cc:2258] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.143734 31212 ts_tablet_manager.cc:1905] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.145232 31212 ts_tablet_manager.cc:1918] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:50:30.145324 31212 log.cc:1196] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/6d84d242911c479c8dd7c004417a71bf
I20260811 00:50:30.145542 31212 ts_tablet_manager.cc:1939] T 6d84d242911c479c8dd7c004417a71bf P dd178bdff6794f98b3edeecd24017e6d: Deleting consensus metadata
I20260811 00:50:30.145874 30074 catalog_manager.cc:4841] TS dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149): tablet 6d84d242911c479c8dd7c004417a71bf (table test-table [id=61bb60097e494a66b4b2be21558daa9b]) successfully deleted
I20260811 00:50:30.146216 31210 tablet_replica.cc:330] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: stopping tablet replica
I20260811 00:50:30.146247 31208 ts_tablet_manager.cc:1905] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.146287 31210 raft_consensus.cc:2229] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:30.146329 31210 raft_consensus.cc:2258] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.146570 31210 ts_tablet_manager.cc:1905] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.147500 31208 ts_tablet_manager.cc:1918] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:50:30.147552 31208 log.cc:1196] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/6d84d242911c479c8dd7c004417a71bf
I20260811 00:50:30.147760 31208 ts_tablet_manager.cc:1939] T 6d84d242911c479c8dd7c004417a71bf P 5d201f89c4c749ffa84987ee7cb38213: Deleting consensus metadata
I20260811 00:50:30.148102 31210 ts_tablet_manager.cc:1918] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:50:30.148165 31210 log.cc:1196] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/6d84d242911c479c8dd7c004417a71bf
I20260811 00:50:30.148397 31210 ts_tablet_manager.cc:1939] T 6d84d242911c479c8dd7c004417a71bf P 911b6cb2ec4d4b45996cfebff050714f: Deleting consensus metadata
I20260811 00:50:30.148582 30074 catalog_manager.cc:4841] TS 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321): tablet 6d84d242911c479c8dd7c004417a71bf (table test-table [id=61bb60097e494a66b4b2be21558daa9b]) successfully deleted
I20260811 00:50:30.148687 30068 catalog_manager.cc:4841] TS 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713): tablet 6d84d242911c479c8dd7c004417a71bf (table test-table [id=61bb60097e494a66b4b2be21558daa9b]) successfully deleted
Aug 11 00:50:30 dist-test-slave-xt4k krb5kdc[30012](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:50:30 dist-test-slave-xt4k krb5kdc[30012](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:30.166862 31222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.160288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.26.99.190:37397)
0811 00:50:30.160437 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.160439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.160447 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:30.160476 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.160477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.160487 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.160542 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:30.161100 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.161620 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.162323 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.162533 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.162586 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.164700 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:30.164701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:30.164702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:30.164709 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:30.165858 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:30.166172 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:30.166173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:30.166174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:30.166226 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:30.166382 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:30.166383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:30.166383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:30.166485 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:30.166574 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.166689 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.166768 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260811 00:50:30.168222 30093 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:30.168397 30093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:30.169653 30881 tablet_service.cc:1467] Processing CreateTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (DEFAULT_TABLE table=test-table [id=94e026f607c542c8b00100b79eac124a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.169658 30637 tablet_service.cc:1467] Processing CreateTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (DEFAULT_TABLE table=test-table [id=94e026f607c542c8b00100b79eac124a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.169780 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.169786 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.170724 31223 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Bootstrap starting.
I20260811 00:50:30.170732 31225 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Bootstrap starting.
I20260811 00:50:30.170770 30365 tablet_service.cc:1467] Processing CreateTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (DEFAULT_TABLE table=test-table [id=94e026f607c542c8b00100b79eac124a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.170917 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.171121 31225 tablet_bootstrap.cc:654] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.171277 31223 tablet_bootstrap.cc:654] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.171715 31225 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: No bootstrap required, opened a new log
I20260811 00:50:30.171768 31225 ts_tablet_manager.cc:1397] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:30.171936 31223 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: No bootstrap required, opened a new log
I20260811 00:50:30.171911 31225 raft_consensus.cc:348] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.171977 31225 raft_consensus.cc:374] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.171984 31223 ts_tablet_manager.cc:1397] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:30.171998 31225 raft_consensus.cc:729] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b6cb2ec4d4b45996cfebff050714f, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.172043 31225 consensus_queue.cc:260] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.172226 31225 ts_tablet_manager.cc:1428] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:30.172186 31223 raft_consensus.cc:348] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.172264 31223 raft_consensus.cc:374] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.172283 31223 raft_consensus.cc:729] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.172324 31223 consensus_queue.cc:260] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.172489 31223 ts_tablet_manager.cc:1428] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:30.172770 31232 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Bootstrap starting.
I20260811 00:50:30.173269 31232 tablet_bootstrap.cc:654] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.173782 31232 tablet_bootstrap.cc:492] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: No bootstrap required, opened a new log
I20260811 00:50:30.173822 31232 ts_tablet_manager.cc:1397] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:30.173931 31232 raft_consensus.cc:348] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.173995 31232 raft_consensus.cc:374] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.174006 31232 raft_consensus.cc:729] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.174054 31232 consensus_queue.cc:260] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.174154 31232 ts_tablet_manager.cc:1428] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:30.182061 31186 raft_consensus.cc:482] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:30.182137 31186 raft_consensus.cc:504] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.182291 31186 leader_election.cc:288] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:30.182473 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ef7ef4ebe94c5cb43e9ceda51a8ad3" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d" is_pre_election: true
I20260811 00:50:30.182489 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ef7ef4ebe94c5cb43e9ceda51a8ad3" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f" is_pre_election: true
I20260811 00:50:30.182559 30679 raft_consensus.cc:2454] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:30.182577 30940 raft_consensus.cc:2454] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 0.
I20260811 00:50:30.182711 30268 leader_election.cc:302] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, dd178bdff6794f98b3edeecd24017e6d; no voters:
I20260811 00:50:30.182807 31186 raft_consensus.cc:2781] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:30.182848 31186 raft_consensus.cc:482] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:30.182868 31186 raft_consensus.cc:3037] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.183648 31186 raft_consensus.cc:504] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.183765 31186 leader_election.cc:288] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Requested vote from peers dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:30.183910 30679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ef7ef4ebe94c5cb43e9ceda51a8ad3" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd178bdff6794f98b3edeecd24017e6d"
I20260811 00:50:30.183931 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ef7ef4ebe94c5cb43e9ceda51a8ad3" candidate_uuid: "5d201f89c4c749ffa84987ee7cb38213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f"
I20260811 00:50:30.183990 30940 raft_consensus.cc:3037] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.183987 30679 raft_consensus.cc:3037] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.184609 30679 raft_consensus.cc:2454] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:30.184612 30940 raft_consensus.cc:2454] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d201f89c4c749ffa84987ee7cb38213 in term 1.
I20260811 00:50:30.184782 30263 leader_election.cc:302] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, 911b6cb2ec4d4b45996cfebff050714f; no voters:
I20260811 00:50:30.184883 31186 raft_consensus.cc:2781] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:30.184934 31186 raft_consensus.cc:686] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Becoming Leader. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Running, Role: LEADER
I20260811 00:50:30.184975 31186 consensus_queue.cc:237] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.185513 30092 catalog_manager.cc:5495] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "5d201f89c4c749ffa84987ee7cb38213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:30.192457 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.190392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55036 (local address 127.26.99.129:36321)
0811 00:50:30.190530 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.190532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.190541 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:30.190576 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.190577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.190587 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.190657 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:30.190753 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.191227 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.191917 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.192097 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.192140 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.192221 (+ 81us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.192245 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.192274 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.192306 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.192320 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":81,"threads_started":1}
I20260811 00:50:30.194362 30679 raft_consensus.cc:1261] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:30.194362 30940 raft_consensus.cc:1261] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Refusing update from remote peer 5d201f89c4c749ffa84987ee7cb38213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:30.194592 31177 consensus_queue.cc:1035] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:30.194682 31186 consensus_queue.cc:1035] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:30.204288 30091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:30.204433 30091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:30.205080 30091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Sending DeleteTablet for 3 replicas of tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3
I20260811 00:50:30.205314 30365 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55014
I20260811 00:50:30.205314 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:40700
I20260811 00:50:30.205322 30881 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:30 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:54220
I20260811 00:50:30.205407 31208 tablet_replica.cc:330] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: stopping tablet replica
I20260811 00:50:30.205407 31212 tablet_replica.cc:330] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: stopping tablet replica
I20260811 00:50:30.205408 31210 tablet_replica.cc:330] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: stopping tablet replica
I20260811 00:50:30.205453 31212 raft_consensus.cc:2229] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:30.205453 31208 raft_consensus.cc:2229] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:30.205456 31210 raft_consensus.cc:2229] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:30.205492 31212 raft_consensus.cc:2258] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.205495 31210 raft_consensus.cc:2258] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.205505 31208 raft_consensus.cc:2258] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:30.205583 30091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:30.205725 30091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:30.205794 31212 ts_tablet_manager.cc:1905] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.205796 31208 ts_tablet_manager.cc:1905] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.206228 31210 ts_tablet_manager.cc:1905] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:30.207044 30637 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 (DEFAULT_TABLE table=test-table [id=63a4dc53ca344d1489c5abcd1ef0a24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.207151 30637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8e408be3a4c858ea21e8ac4a72815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.207325 31212 ts_tablet_manager.cc:1918] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:30.207346 31208 ts_tablet_manager.cc:1918] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:30.207379 31212 log.cc:1196] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/07ef7ef4ebe94c5cb43e9ceda51a8ad3
I20260811 00:50:30.207389 31208 log.cc:1196] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/07ef7ef4ebe94c5cb43e9ceda51a8ad3
I20260811 00:50:30.207582 31212 ts_tablet_manager.cc:1939] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P dd178bdff6794f98b3edeecd24017e6d: Deleting consensus metadata
I20260811 00:50:30.207588 31208 ts_tablet_manager.cc:1939] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 5d201f89c4c749ffa84987ee7cb38213: Deleting consensus metadata
I20260811 00:50:30.207707 31210 ts_tablet_manager.cc:1918] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:30.207759 31210 log.cc:1196] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/07ef7ef4ebe94c5cb43e9ceda51a8ad3
I20260811 00:50:30.207985 31210 ts_tablet_manager.cc:1939] T 07ef7ef4ebe94c5cb43e9ceda51a8ad3 P 911b6cb2ec4d4b45996cfebff050714f: Deleting consensus metadata
I20260811 00:50:30.208472 30074 catalog_manager.cc:4841] TS dd178bdff6794f98b3edeecd24017e6d (127.26.99.130:34149): tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (table test-table [id=94e026f607c542c8b00100b79eac124a]) successfully deleted
I20260811 00:50:30.208534 30068 catalog_manager.cc:4841] TS 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713): tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (table test-table [id=94e026f607c542c8b00100b79eac124a]) successfully deleted
I20260811 00:50:30.208566 31223 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Bootstrap starting.
I20260811 00:50:30.208618 30881 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 (DEFAULT_TABLE table=test-table [id=63a4dc53ca344d1489c5abcd1ef0a24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.208699 30881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8e408be3a4c858ea21e8ac4a72815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.209124 31223 tablet_bootstrap.cc:654] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.209110 30365 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 (DEFAULT_TABLE table=test-table [id=63a4dc53ca344d1489c5abcd1ef0a24e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:30.209208 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8e408be3a4c858ea21e8ac4a72815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:30.209776 31223 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: No bootstrap required, opened a new log
I20260811 00:50:30.209821 31223 ts_tablet_manager.cc:1397] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:30.209898 31225 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Bootstrap starting.
I20260811 00:50:30.209964 31223 raft_consensus.cc:348] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.210028 31223 raft_consensus.cc:374] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.210045 31223 raft_consensus.cc:729] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.210110 31223 consensus_queue.cc:260] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.210199 31223 ts_tablet_manager.cc:1428] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:30.210201 31225 tablet_bootstrap.cc:654] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.210453 31232 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213: Bootstrap starting.
I20260811 00:50:30.210445 30074 catalog_manager.cc:4841] TS 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321): tablet 07ef7ef4ebe94c5cb43e9ceda51a8ad3 (table test-table [id=94e026f607c542c8b00100b79eac124a]) successfully deleted
I20260811 00:50:30.210804 31232 tablet_bootstrap.cc:654] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:30.211153 31225 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: No bootstrap required, opened a new log
I20260811 00:50:30.211194 31225 ts_tablet_manager.cc:1397] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:30.211297 31225 raft_consensus.cc:348] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.211347 31225 raft_consensus.cc:374] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.211359 31225 raft_consensus.cc:729] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 911b6cb2ec4d4b45996cfebff050714f, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.211390 31225 consensus_queue.cc:260] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.211473 31225 ts_tablet_manager.cc:1428] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:30.211835 31232 tablet_bootstrap.cc:492] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213: No bootstrap required, opened a new log
I20260811 00:50:30.211889 31232 ts_tablet_manager.cc:1397] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:30.211995 31232 raft_consensus.cc:348] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.212060 31232 raft_consensus.cc:374] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:30.212080 31232 raft_consensus.cc:729] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d201f89c4c749ffa84987ee7cb38213, State: Initialized, Role: FOLLOWER
I20260811 00:50:30.212123 31232 consensus_queue.cc:260] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.212209 31232 ts_tablet_manager.cc:1428] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:30.407347 31234 raft_consensus.cc:482] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:30.407486 31234 raft_consensus.cc:504] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.407814 31234 leader_election.cc:288] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:30.412011 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.408105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:53209 (local address 127.26.99.131:38713)
0811 00:50:30.408220 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.408222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.408232 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:30.408305 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.408306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.408318 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.408431 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:30.408618 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.409375 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.410988 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.411591 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.411667 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.411675 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.411873 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.411926 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
I20260811 00:50:30.412002 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.408089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:39527 (local address 127.26.99.129:36321)
0811 00:50:30.408141 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.408143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.408252 (+ 109us) server_negotiation.cc:407] Connection header received
0811 00:50:30.408307 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.408308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.408319 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.408417 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:30.408617 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.409376 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.410988 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.411588 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.411666 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.411675 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.411875 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.411926 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:50:30.412009 31265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.408021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.26.99.130:39527)
0811 00:50:30.408175 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:30.408182 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:30.408244 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:30.408428 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:30.408428 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:30.408431 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:30.408544 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.408547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.409503 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.409504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.410875 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.410879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.411674 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.411675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.411760 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.411767 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:50:30.411826 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:50:30.411877 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":52,"thread_start_us":97,"threads_started":1}
I20260811 00:50:30.412009 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.408021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38713 (local address 127.26.99.130:53209)
0811 00:50:30.408170 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:30.408182 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:30.408241 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:30.408432 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:30.408432 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:30.408434 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:30.408549 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.408551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.409478 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.409480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.410874 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.410879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.411672 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.411673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.411760 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.411766 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:50:30.411826 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:50:30.411876 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":145,"thread_start_us":66,"threads_started":1}
I20260811 00:50:30.412307 30412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8e408be3a4c858ea21e8ac4a72815" candidate_uuid: "dd178bdff6794f98b3edeecd24017e6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d201f89c4c749ffa84987ee7cb38213" is_pre_election: true
I20260811 00:50:30.412479 30412 raft_consensus.cc:2454] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd178bdff6794f98b3edeecd24017e6d in term 0.
I20260811 00:50:30.412524 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8e408be3a4c858ea21e8ac4a72815" candidate_uuid: "dd178bdff6794f98b3edeecd24017e6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f" is_pre_election: true
I20260811 00:50:30.412624 30940 raft_consensus.cc:2454] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd178bdff6794f98b3edeecd24017e6d in term 0.
I20260811 00:50:30.412686 30540 leader_election.cc:302] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d201f89c4c749ffa84987ee7cb38213, dd178bdff6794f98b3edeecd24017e6d; no voters:
I20260811 00:50:30.412815 31234 raft_consensus.cc:2781] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:30.412865 31234 raft_consensus.cc:482] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:30.412889 31234 raft_consensus.cc:3037] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.413615 31234 raft_consensus.cc:504] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.413745 31234 leader_election.cc:288] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [CANDIDATE]: Term 1 election: Requested vote from peers 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321), 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713)
I20260811 00:50:30.413879 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8e408be3a4c858ea21e8ac4a72815" candidate_uuid: "dd178bdff6794f98b3edeecd24017e6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "911b6cb2ec4d4b45996cfebff050714f"
I20260811 00:50:30.413897 30412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8e408be3a4c858ea21e8ac4a72815" candidate_uuid: "dd178bdff6794f98b3edeecd24017e6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d201f89c4c749ffa84987ee7cb38213"
I20260811 00:50:30.413949 30940 raft_consensus.cc:3037] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.413959 30412 raft_consensus.cc:3037] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:30.414484 30940 raft_consensus.cc:2454] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd178bdff6794f98b3edeecd24017e6d in term 1.
I20260811 00:50:30.414676 30535 leader_election.cc:302] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 911b6cb2ec4d4b45996cfebff050714f, dd178bdff6794f98b3edeecd24017e6d; no voters:
I20260811 00:50:30.414768 31234 raft_consensus.cc:2781] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:30.414846 30412 raft_consensus.cc:2454] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd178bdff6794f98b3edeecd24017e6d in term 1.
I20260811 00:50:30.414937 31234 raft_consensus.cc:686] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 1 LEADER]: Becoming Leader. State: Replica: dd178bdff6794f98b3edeecd24017e6d, State: Running, Role: LEADER
I20260811 00:50:30.415016 31234 consensus_queue.cc:237] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } }
I20260811 00:50:30.415738 30091 catalog_manager.cc:5495] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d reported cstate change: term changed from 0 to 1, leader changed from <none> to dd178bdff6794f98b3edeecd24017e6d (127.26.99.130). New cstate: current_term: 1 leader_uuid: "dd178bdff6794f98b3edeecd24017e6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd178bdff6794f98b3edeecd24017e6d" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:30.441805 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.439585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.26.99.130:34149)
0811 00:50:30.439758 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.439759 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.439766 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:30.439802 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.439803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.439823 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.439892 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:30.439989 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.440548 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.441196 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.441385 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.441427 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.441538 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.441643 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.441689 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.441715 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.441732 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
I20260811 00:50:30.446416 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.444134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.26.99.130:60203)
0811 00:50:30.444350 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:30.444360 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:30.444415 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:30.444550 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:30.444551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:30.444553 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:30.444611 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.444612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.445163 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.445163 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.445750 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.445752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.446094 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.446095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.446142 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.446156 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.446282 (+ 126us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.446283 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:30.446312 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 00:50:30.446346 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":104,"threads_started":1}
I20260811 00:50:30.446413 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.444214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:60203 (local address 127.26.99.129:36321)
0811 00:50:30.444265 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.444266 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.444427 (+ 161us) server_negotiation.cc:407] Connection header received
0811 00:50:30.444450 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.444450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.444464 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.444514 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:30.444675 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.445114 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.445823 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.446018 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.446079 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.446218 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.446243 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.446275 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.446317 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.446340 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:30.448411 30940 raft_consensus.cc:1261] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Refusing update from remote peer dd178bdff6794f98b3edeecd24017e6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:30.448488 30412 raft_consensus.cc:1261] T c4d8e408be3a4c858ea21e8ac4a72815 P 5d201f89c4c749ffa84987ee7cb38213 [term 1 FOLLOWER]: Refusing update from remote peer dd178bdff6794f98b3edeecd24017e6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:30.448697 31268 consensus_queue.cc:1035] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "911b6cb2ec4d4b45996cfebff050714f" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:30.449199 31268 consensus_queue.cc:1035] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d201f89c4c749ffa84987ee7cb38213" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:30.456291 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.453947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:44903 (local address 127.26.99.130:34149)
0811 00:50:30.453987 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:30.453989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:30.454186 (+ 197us) server_negotiation.cc:407] Connection header received
0811 00:50:30.454230 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:30.454230 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:30.454240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:30.454280 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:30.454383 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.454879 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.455676 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.455972 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.456027 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.456135 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.456160 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.456188 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:30.456221 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 00:50:30.456236 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:30.456307 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:30.453888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34149 (local address 127.26.99.129:44903)
0811 00:50:30.454123 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:30.454132 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:30.454179 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:30.454292 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:30.454293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:30.454294 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:30.454341 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.454343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.454949 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.454950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.455593 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:30.455597 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:30.456029 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:30.456030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:30.456077 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:30.456081 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:30.456190 (+ 109us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:30.456191 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:30.456219 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 00:50:30.456253 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":190,"threads_started":1}
W20260811 00:50:30.456578 31182 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 00:50:31.974787 30091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:31.974886 30091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:31.975660 30091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6015b6cc669448869b38a9aeec1355c3: Sending DeleteTablet for 3 replicas of tablet c4d8e408be3a4c858ea21e8ac4a72815
I20260811 00:50:31.975885 30365 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:31 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55014
I20260811 00:50:31.975899 30637 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:31 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:40700
I20260811 00:50:31.975976 30881 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8e408be3a4c858ea21e8ac4a72815 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:31 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:54220
I20260811 00:50:31.976066 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30230
I20260811 00:50:31.984027 31328 tablet_replica.cc:330] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: stopping tablet replica
I20260811 00:50:31.984102 31328 raft_consensus.cc:2229] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:31.984138 31328 raft_consensus.cc:2258] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:31.984422 31328 ts_tablet_manager.cc:1905] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:31.985908 31328 ts_tablet_manager.cc:1918] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:50:31.985967 31328 log.cc:1196] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/c4d8e408be3a4c858ea21e8ac4a72815
I20260811 00:50:31.986145 31328 ts_tablet_manager.cc:1939] T c4d8e408be3a4c858ea21e8ac4a72815 P 911b6cb2ec4d4b45996cfebff050714f: Deleting consensus metadata
I20260811 00:50:31.987216 30068 catalog_manager.cc:4841] TS 911b6cb2ec4d4b45996cfebff050714f (127.26.99.131:38713): tablet c4d8e408be3a4c858ea21e8ac4a72815 (table test-table [id=63a4dc53ca344d1489c5abcd1ef0a24e]) successfully deleted
W20260811 00:50:31.993086 30074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:36321 (error 108)
I20260811 00:50:31.993119 31327 tablet_replica.cc:330] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: stopping tablet replica
I20260811 00:50:31.993175 31327 raft_consensus.cc:2229] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:31.993276 31327 raft_consensus.cc:2258] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:31.993669 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:31.993439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36321 (local address 127.0.0.1:55052)
0811 00:50:31.993572 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:31.993623 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260811 00:50:31.993734 31327 ts_tablet_manager.cc:1905] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 00:50:31.993783 30074 catalog_manager.cc:4584] TS 5d201f89c4c749ffa84987ee7cb38213 (127.26.99.129:36321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4d8e408be3a4c858ea21e8ac4a72815: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36321: connect: Connection refused (error 111)
I20260811 00:50:31.995045 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30513
I20260811 00:50:31.995061 31327 ts_tablet_manager.cc:1918] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 00:50:31.995117 31327 log.cc:1196] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/c4d8e408be3a4c858ea21e8ac4a72815
I20260811 00:50:31.995359 31327 ts_tablet_manager.cc:1939] T c4d8e408be3a4c858ea21e8ac4a72815 P dd178bdff6794f98b3edeecd24017e6d: Deleting consensus metadata
I20260811 00:50:32.009287 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30773
I20260811 00:50:32.009346 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:32.009223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34149 (local address 127.0.0.1:40724)
0811 00:50:32.009283 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:32.009307 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.130:34149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 00:50:32.021062 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30038
2026-08-11T00:50:32Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5869 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:32 dist-test-slave-xt4k krb5kdc[31335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:32 dist-test-slave-xt4k krb5kdc[31335](info): set up 2 sockets
Aug 11 00:50:32 dist-test-slave-xt4k krb5kdc[31335](info): commencing operation
krb5kdc: starting...
W20260811 00:50:33.223677 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:33.339093 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33505
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:33.421797 31367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:33.422016 31367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:33.422037 31367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:33.423324 31367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:33.423377 31367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:33.423390 31367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:33.423401 31367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:33.423413 31367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:33.425076 31367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:33.425334 31367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:33.425555 31367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:33.430688 31379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.430734 31367 server_base.cc:1034] running on GCE node
W20260811 00:50:33.430701 31381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:33.430688 31386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.431313 31367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:33.431612 31367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:33.432793 31367 hybrid_clock.cc:648] HybridClock initialized: now 1786409433432762 us; error 72 us; skew 500 ppm
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:33.438169 31367 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:33.438581 31367 webserver.cc:460] Webserver started at http://127.26.99.190:43751/ using document root <none> and password file <none>
I20260811 00:50:33.438777 31367 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:33.438817 31367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:33.438910 31367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:33.439908 31367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "a6e34ae46da74bd681c5ca6d7c8081e0"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c6bf9ab5fbf1a23edf352a8b1ba97c16"
server_key_iv: "34f3a6b0d32cf1edccff50489e880a34"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.440215 31367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "a6e34ae46da74bd681c5ca6d7c8081e0"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c6bf9ab5fbf1a23edf352a8b1ba97c16"
server_key_iv: "34f3a6b0d32cf1edccff50489e880a34"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.441591 31367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:33.442269 31396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.442435 31367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:33.442523 31367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "a6e34ae46da74bd681c5ca6d7c8081e0"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c6bf9ab5fbf1a23edf352a8b1ba97c16"
server_key_iv: "34f3a6b0d32cf1edccff50489e880a34"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.442592 31367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:33.454551 31367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:33.456665 31367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:33.456802 31367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:33.460531 31367 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:33505
I20260811 00:50:33.460582 31476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:33505 every 8 connection(s)
I20260811 00:50:33.460906 31367 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:33.461778 31482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:33.464071 31482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0: Bootstrap starting.
I20260811 00:50:33.464071 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31367
I20260811 00:50:33.464166 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:33.464324 27022 external_mini_cluster.cc:1428] Setting key ec95b09fd1db8814f51f00a13183563c
I20260811 00:50:33.464823 31482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:33.465135 31482 log.cc:824] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:33.465831 31482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0: No bootstrap required, opened a new log
I20260811 00:50:33.467948 31482 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } }
I20260811 00:50:33.468118 31482 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:33.468151 31482 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e34ae46da74bd681c5ca6d7c8081e0, State: Initialized, Role: FOLLOWER
I20260811 00:50:33.468268 31482 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } }
I20260811 00:50:33.468358 31482 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:33.468398 31482 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:33.468446 31482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:33.468972 31482 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } }
I20260811 00:50:33.469077 31482 leader_election.cc:302] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6e34ae46da74bd681c5ca6d7c8081e0; no voters:
I20260811 00:50:33.469245 31482 leader_election.cc:288] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:33.469285 31491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:33.469503 31482 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:33.469743 31491 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [term 1 LEADER]: Becoming Leader. State: Replica: a6e34ae46da74bd681c5ca6d7c8081e0, State: Running, Role: LEADER
I20260811 00:50:33.469907 31491 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } }
I20260811 00:50:33.470337 31492 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } } }
I20260811 00:50:33.470404 31493 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6e34ae46da74bd681c5ca6d7c8081e0. Latest consensus state: current_term: 1 leader_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6e34ae46da74bd681c5ca6d7c8081e0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33505 } } }
I20260811 00:50:33.470486 31493 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:33.470418 31492 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:33.470870 31504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:33.471516 31504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:33.473206 31504 catalog_manager.cc:1347] Generated new cluster ID: a42bcae9184e44e88ca76e9561cc77ca
I20260811 00:50:33.473260 31504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:33.475806 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.464859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.26.99.190:33505)
0811 00:50:33.465017 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:33.465025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:33.465051 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:50:33.465595 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:33.465604 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:33.465657 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:33.465773 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:33.466557 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.467419 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.468463 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.468964 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.469059 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.471924 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:33.471932 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:33.471933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:33.471954 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:33.474088 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.474482 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.474486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.474486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.474603 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.474782 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.474783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.474783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.475184 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:33.475352 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:33.475434 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 00:50:33.475585 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260811 00:50:33.487450 31504 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:33.487948 31504 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:33.495097 31504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6e34ae46da74bd681c5ca6d7c8081e0: Generated new TSK 0
I20260811 00:50:33.495270 31504 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:33.521157 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:33.602247 31524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:33.602473 31524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:33.602495 31524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:33.603641 31524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:33.603681 31524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:33.603705 31524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:33.605134 31524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:33.605393 31524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:33.605608 31524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:33.610548 31532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.610682 31524 server_base.cc:1034] running on GCE node
W20260811 00:50:33.610584 31533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:33.610548 31537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.611053 31524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:33.611284 31524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:33.612419 31524 hybrid_clock.cc:648] HybridClock initialized: now 1786409433612423 us; error 59 us; skew 500 ppm
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:33.614859 31524 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:33.615267 31524 webserver.cc:460] Webserver started at http://127.26.99.129:44419/ using document root <none> and password file <none>
I20260811 00:50:33.615507 31524 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:33.615554 31524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:33.615659 31524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:33.616721 31524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "12aa9e7572904b298dd4eae663dc180c"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "6282d73f521f4c1ab5278be6c2f96fa8"
server_key_iv: "1acb02193ada8ea41d62255864a63c36"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.617045 31524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "12aa9e7572904b298dd4eae663dc180c"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "6282d73f521f4c1ab5278be6c2f96fa8"
server_key_iv: "1acb02193ada8ea41d62255864a63c36"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.618353 31524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:33.619065 31545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.619237 31524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:33.619323 31524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "12aa9e7572904b298dd4eae663dc180c"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "6282d73f521f4c1ab5278be6c2f96fa8"
server_key_iv: "1acb02193ada8ea41d62255864a63c36"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.619390 31524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:33.639459 31524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:33.641369 31524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:33.641502 31524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:33.641731 31524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:33.642038 31524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:33.642073 31524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.642102 31524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:33.642118 31524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.647796 31524 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:41587
I20260811 00:50:33.647899 31803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:41587 every 8 connection(s)
I20260811 00:50:33.648144 31524 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:33.655930 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31524
I20260811 00:50:33.656039 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:33.656222 27022 external_mini_cluster.cc:1428] Setting key 48a8fd15783566309f0da1cce8d34582
I20260811 00:50:33.656514 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.648860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:55901 (local address 127.26.99.190:33505)
0811 00:50:33.648926 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:33.648928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:33.649122 (+ 194us) server_negotiation.cc:407] Connection header received
0811 00:50:33.649593 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:33.649594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:33.649605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:33.649657 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:33.650528 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.651024 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.651972 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.652167 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.652214 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.654211 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:33.654212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:33.654213 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:33.654219 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:33.655278 (+ 1059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.655609 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.655610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.655610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.655656 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.655836 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.655836 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.655837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.655980 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:33.656057 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:33.656305 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 00:50:33.656420 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:50:33.656635 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.648835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33505 (local address 127.26.99.129:55901)
0811 00:50:33.649011 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:33.649046 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:33.649510 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:33.649719 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:33.649723 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:33.650274 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:33.650460 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.650465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.651104 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.651105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.651907 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.651910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.652222 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.652223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.652315 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.652846 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:33.652854 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:33.654137 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:33.655341 (+ 1204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.655346 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.655348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.655553 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.655701 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.655701 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.655701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.655785 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.656053 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:33.656058 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:33.656179 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 00:50:33.656261 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:50:33.656424 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260811 00:50:33.657083 31812 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33505
I20260811 00:50:33.657188 31812 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:33.657364 31812 heartbeater.cc:511] Master 127.26.99.190:33505 requested a full tablet report, sending...
I20260811 00:50:33.657840 31422 ts_manager.cc:194] Registered new tserver with Master: 12aa9e7572904b298dd4eae663dc180c (127.26.99.129:41587)
I20260811 00:50:33.658448 31422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:55901
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:33.680024 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:33.760703 31819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:33.760902 31819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:33.760923 31819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:33.762064 31819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:33.762105 31819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:33.762130 31819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:33.763587 31819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:33.763808 31819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:33.764027 31819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:33.768801 31828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.768898 31819 server_base.cc:1034] running on GCE node
W20260811 00:50:33.768841 31830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:33.769007 31826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.769200 31819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:33.769429 31819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:33.770571 31819 hybrid_clock.cc:648] HybridClock initialized: now 1786409433770553 us; error 30 us; skew 500 ppm
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:33.773065 31819 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:33.773567 31819 webserver.cc:460] Webserver started at http://127.26.99.130:45409/ using document root <none> and password file <none>
I20260811 00:50:33.773798 31819 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:33.773849 31819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:33.773973 31819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:33.775122 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "e0eb8147f1f842b3aab280aaf744300b"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "171065df2adb64e6a8c5f07b6b4d0cf9"
server_key_iv: "68fd876389bfbdf46ab004b807efe9b3"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.775468 31819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "e0eb8147f1f842b3aab280aaf744300b"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "171065df2adb64e6a8c5f07b6b4d0cf9"
server_key_iv: "68fd876389bfbdf46ab004b807efe9b3"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.776747 31819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:33.777419 31847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.777585 31819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.777669 31819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "e0eb8147f1f842b3aab280aaf744300b"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "171065df2adb64e6a8c5f07b6b4d0cf9"
server_key_iv: "68fd876389bfbdf46ab004b807efe9b3"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.777730 31819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:33.793239 31819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:33.795384 31819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:33.795531 31819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:33.795751 31819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:33.796047 31819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:33.796082 31819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.796110 31819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:33.796132 31819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.801833 31819 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:40179
I20260811 00:50:33.801896 32046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:40179 every 8 connection(s)
I20260811 00:50:33.802187 31819 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:33.804659 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31819
I20260811 00:50:33.804764 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:33.804949 27022 external_mini_cluster.cc:1428] Setting key 3d3a4ff500f14ecc82efda51416726d3
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:33.811928 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.802905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47671 (local address 127.26.99.190:33505)
0811 00:50:33.802965 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:33.802968 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:33.803158 (+ 190us) server_negotiation.cc:407] Connection header received
0811 00:50:33.803668 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:33.803669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:33.803682 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:33.803746 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:33.804799 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.805376 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.806700 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.806902 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.806986 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.809216 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:33.809218 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:33.809218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:33.809225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:33.810562 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.811046 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.811046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.811047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.811092 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.811346 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.811346 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.811346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.811441 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:33.811497 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:33.811799 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 00:50:33.811863 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:33.812215 32050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.802840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33505 (local address 127.26.99.130:47671)
0811 00:50:33.803034 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:33.803073 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:33.803568 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:33.803815 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:33.803819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:33.804401 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:33.804664 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.804671 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.805464 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.805465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.806600 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.806603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.806992 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.806993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.807134 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.807658 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:33.807666 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:33.809110 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:33.810656 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.810663 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.810666 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.810972 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.811148 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.811149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.811149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.811286 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.811494 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:33.811500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:33.811666 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 00:50:33.811788 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 00:50:33.811958 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":87,"threads_started":1}
I20260811 00:50:33.812776 32047 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33505
I20260811 00:50:33.812877 32047 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:33.813061 32047 heartbeater.cc:511] Master 127.26.99.190:33505 requested a full tablet report, sending...
I20260811 00:50:33.813438 31422 ts_manager.cc:194] Registered new tserver with Master: e0eb8147f1f842b3aab280aaf744300b (127.26.99.130:40179)
I20260811 00:50:33.813803 31422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:47671
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:33.831085 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:33.911512 32057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:33.911713 32057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:33.911744 32057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:33.912902 32057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:33.912941 32057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:33.912976 32057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:33.914371 32057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33505
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:33.914614 32057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:33.914813 32057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:33.919611 32071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:33.919639 32066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.919720 32057 server_base.cc:1034] running on GCE node
W20260811 00:50:33.919646 32067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:33.920004 32057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:33.920240 32057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:33.921368 32057 hybrid_clock.cc:648] HybridClock initialized: now 1786409433921364 us; error 41 us; skew 500 ppm
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:33.923744 32057 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:33.924165 32057 webserver.cc:460] Webserver started at http://127.26.99.131:33291/ using document root <none> and password file <none>
I20260811 00:50:33.924417 32057 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:33.924477 32057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:33.924602 32057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:33.925590 32057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "4010c0e98dd6489580ab3f1ac22201ae"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c0ec3c315081e11cb1ae818d7d21a6ed"
server_key_iv: "49ab9b089698d4095bb41106118040a1"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.925917 32057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "4010c0e98dd6489580ab3f1ac22201ae"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c0ec3c315081e11cb1ae818d7d21a6ed"
server_key_iv: "49ab9b089698d4095bb41106118040a1"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.927201 32057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:33.927878 32085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.928033 32057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:33.928118 32057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "4010c0e98dd6489580ab3f1ac22201ae"
format_stamp: "Formatted at 2026-08-11 00:50:33 on dist-test-slave-xt4k"
server_key: "c0ec3c315081e11cb1ae818d7d21a6ed"
server_key_iv: "49ab9b089698d4095bb41106118040a1"
server_key_version: "encryptionkey@0"
I20260811 00:50:33.928182 32057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:33.938750 32057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:33.940439 32057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:33.940572 32057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:33.940760 32057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:33.941039 32057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:33.941072 32057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.941099 32057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:33.941120 32057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:33.946903 32057 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:36671
I20260811 00:50:33.946959 32285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:36671 every 8 connection(s)
I20260811 00:50:33.947242 32057 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:50:33 dist-test-slave-xt4k krb5kdc[31335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409433, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:33.955870 31488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.947988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:43251 (local address 127.26.99.190:33505)
0811 00:50:33.948045 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:33.948046 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:33.948237 (+ 191us) server_negotiation.cc:407] Connection header received
0811 00:50:33.948787 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:33.948788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:33.948798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:33.948859 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:33.949794 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.950350 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.951278 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.951486 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.951540 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.953610 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:33.953611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:33.953611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:33.953626 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:33.954770 (+ 1144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.955129 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.955130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.955130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.955176 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:33.955362 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:33.955362 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:33.955362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:33.955459 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:33.955501 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:33.955701 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 00:50:33.955779 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:50:33.955964 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32057
I20260811 00:50:33.956048 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:33.956058 32293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:33.947921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33505 (local address 127.26.99.131:43251)
0811 00:50:33.948091 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:33.948143 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:33.948679 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:33.948920 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:33.948923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:33.949492 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:33.949686 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.949690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.950418 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.950419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.951203 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:33.951205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:33.951567 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:33.951568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:33.951685 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:33.952104 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:33.952112 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:33.953520 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:33.954842 (+ 1322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.954849 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.954850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.955070 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.955234 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:33.955234 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:33.955235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:33.955321 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:33.955499 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:33.955501 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:33.955609 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 00:50:33.955684 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:50:33.955807 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260811 00:50:33.956264 27022 external_mini_cluster.cc:1428] Setting key eac6161b7aabcb369b84aba7570b8cc7
I20260811 00:50:33.956558 32286 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33505
I20260811 00:50:33.956693 32286 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:33.956892 32286 heartbeater.cc:511] Master 127.26.99.190:33505 requested a full tablet report, sending...
I20260811 00:50:33.957219 31422 ts_manager.cc:194] Registered new tserver with Master: 4010c0e98dd6489580ab3f1ac22201ae (127.26.99.131:36671)
I20260811 00:50:33.957580 31422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:43251
I20260811 00:50:33.967892 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 00:50:33.979578 31488 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:33.978846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.26.99.190:33505)
0811 00:50:33.978902 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:33.978904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:33.978914 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:33.978975 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:33.978976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:33.978985 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:33.979046 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:33.979506 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55894: BlockingRecv error: recv got EOF from 127.0.0.1:55894 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:50:33.980530 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31524
I20260811 00:50:33.997162 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31819
I20260811 00:50:34.005391 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32057
I20260811 00:50:34.021260 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31367
2026-08-11T00:50:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1996 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:34 dist-test-slave-xt4k krb5kdc[32315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:34 dist-test-slave-xt4k krb5kdc[32315](info): set up 2 sockets
Aug 11 00:50:34 dist-test-slave-xt4k krb5kdc[32315](info): commencing operation
krb5kdc: starting...
W20260811 00:50:35.218976 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:35.339725 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44423
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:44423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:35.422106 32342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:35.422299 32342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:35.422320 32342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:35.423452 32342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:35.423497 32342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:35.423511 32342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:35.423522 32342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:35.423547 32342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:35.425119 32342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:44423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:35.425352 32342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:35.425587 32342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:35.430356 32355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:35.430305 32352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:35.430400 32342 server_base.cc:1034] running on GCE node
W20260811 00:50:35.430299 32348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:35.430749 32342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:35.431015 32342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:35.432157 32342 hybrid_clock.cc:648] HybridClock initialized: now 1786409435432141 us; error 37 us; skew 500 ppm
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409435, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:35.435338 32342 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:35.435833 32342 webserver.cc:460] Webserver started at http://127.26.99.190:39829/ using document root <none> and password file <none>
I20260811 00:50:35.436035 32342 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:35.436084 32342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:35.436214 32342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:35.437330 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "9dc4298ab1ca43e6ba385837ad046a7a"
format_stamp: "Formatted at 2026-08-11 00:50:35 on dist-test-slave-xt4k"
server_key: "280c71d6f0140b3fe991b18db91893a8"
server_key_iv: "516a6838659a87d177982a7ee18b31e9"
server_key_version: "encryptionkey@0"
I20260811 00:50:35.437682 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "9dc4298ab1ca43e6ba385837ad046a7a"
format_stamp: "Formatted at 2026-08-11 00:50:35 on dist-test-slave-xt4k"
server_key: "280c71d6f0140b3fe991b18db91893a8"
server_key_iv: "516a6838659a87d177982a7ee18b31e9"
server_key_version: "encryptionkey@0"
I20260811 00:50:35.438982 32342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:35.439671 32366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:35.439987 32342 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:35.440146 32342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "9dc4298ab1ca43e6ba385837ad046a7a"
format_stamp: "Formatted at 2026-08-11 00:50:35 on dist-test-slave-xt4k"
server_key: "280c71d6f0140b3fe991b18db91893a8"
server_key_iv: "516a6838659a87d177982a7ee18b31e9"
server_key_version: "encryptionkey@0"
I20260811 00:50:35.440364 32342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:35.453358 32342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:35.455559 32342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:35.455690 32342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:35.459517 32342 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:44423
I20260811 00:50:35.459575 32467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:44423 every 8 connection(s)
I20260811 00:50:35.460033 32342 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:35.460775 32468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:35.463100 32468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: Bootstrap starting.
I20260811 00:50:35.463696 32468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:35.463972 32468 log.cc:824] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:35.464787 32468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: No bootstrap required, opened a new log
I20260811 00:50:35.465296 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32342
I20260811 00:50:35.465368 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:35.465543 27022 external_mini_cluster.cc:1428] Setting key 02265bfcda3e2115c3bb9ba79332b982
I20260811 00:50:35.467381 32468 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } }
I20260811 00:50:35.467573 32468 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:35.467612 32468 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dc4298ab1ca43e6ba385837ad046a7a, State: Initialized, Role: FOLLOWER
I20260811 00:50:35.467774 32468 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } }
I20260811 00:50:35.467859 32468 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:35.467881 32468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:35.467929 32468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:35.468631 32468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } }
I20260811 00:50:35.468741 32468 leader_election.cc:302] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dc4298ab1ca43e6ba385837ad046a7a; no voters:
I20260811 00:50:35.468900 32468 leader_election.cc:288] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:35.468957 32478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:35.469156 32468 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:35.469161 32478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [term 1 LEADER]: Becoming Leader. State: Replica: 9dc4298ab1ca43e6ba385837ad046a7a, State: Running, Role: LEADER
I20260811 00:50:35.469415 32478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } }
I20260811 00:50:35.469789 32481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dc4298ab1ca43e6ba385837ad046a7a. Latest consensus state: current_term: 1 leader_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } } }
I20260811 00:50:35.469874 32481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:35.470316 32479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dc4298ab1ca43e6ba385837ad046a7a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44423 } } }
I20260811 00:50:35.470391 32479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a [sys.catalog]: This master's current role is: LEADER
W20260811 00:50:35.471607 32499 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:35.471654 32499 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:35.471706 32488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:35.471853 32488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:35.473531 32488 catalog_manager.cc:1347] Generated new cluster ID: 14c7f82df6ba451195802ba4705fcaf1
I20260811 00:50:35.473584 32488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:35.478184 32477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:35.466148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.26.99.190:44423)
0811 00:50:35.466364 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:35.466375 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:35.466411 (+ 36us) server_negotiation.cc:407] Connection header received
0811 00:50:35.467354 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:35.467365 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:35.467433 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:35.467588 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:35.468320 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:35.469910 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:35.471176 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:35.471818 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:35.471930 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:35.474574 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:35.474578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:35.474579 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:35.474591 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:35.476570 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:35.476944 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:35.476949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:35.476949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:35.477090 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:35.477262 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:35.477262 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:35.477263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:35.477597 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:35.477765 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:35.477835 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 00:50:35.477980 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260811 00:50:35.479337 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:50:35.484104 32488 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:35.484645 32488 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:35.493290 32488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dc4298ab1ca43e6ba385837ad046a7a: Generated new TSK 0
I20260811 00:50:35.493518 32488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:50:35.497328 32477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:35.493386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.26.99.190:44423)
0811 00:50:35.493428 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:35.493430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:35.493663 (+ 233us) server_negotiation.cc:407] Connection header received
0811 00:50:35.493808 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:35.493810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:35.493822 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:35.493890 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:35.494312 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:35.494815 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:35.495904 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:35.496176 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:35.496248 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:35.496916 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:35.496917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:35.496917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:35.497099 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:35.497115 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:35.497121 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:35.497167 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:35.497230 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 00:50:35.497256 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:50:35.500074 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32342
2026-08-11T00:50:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1496 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32532](info): set up 2 sockets
Aug 11 00:50:35 dist-test-slave-xt4k krb5kdc[32532](info): commencing operation
krb5kdc: starting...
W20260811 00:50:36.719762 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:36 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:36.837244 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39097
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:39097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:36.918023 32556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:36.918243 32556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:36.918265 32556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:36.919351 32556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:36.919389 32556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:36.919400 32556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:36.919411 32556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:36.919422 32556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:36.920873 32556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:39097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:36.921068 32556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:36.921283 32556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:36.926038 32573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:36.926092 32556 server_base.cc:1034] running on GCE node
W20260811 00:50:36.926148 32571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:36.926067 32570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:36.926457 32556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:36.926716 32556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:36.927871 32556 hybrid_clock.cc:648] HybridClock initialized: now 1786409436927854 us; error 30 us; skew 500 ppm
Aug 11 00:50:36 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409436, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:36.930280 32556 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:36.930698 32556 webserver.cc:460] Webserver started at http://127.26.99.190:45371/ using document root <none> and password file <none>
I20260811 00:50:36.930895 32556 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:36.930944 32556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:36.931070 32556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:36.932118 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "21a14bffb4d04c7eaf0cdff032091b03"
format_stamp: "Formatted at 2026-08-11 00:50:36 on dist-test-slave-xt4k"
server_key: "6f832216f04e9b988ee5b3c799894663"
server_key_iv: "94386cc005d27986fa2a198c7fb3de70"
server_key_version: "encryptionkey@0"
I20260811 00:50:36.932485 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "21a14bffb4d04c7eaf0cdff032091b03"
format_stamp: "Formatted at 2026-08-11 00:50:36 on dist-test-slave-xt4k"
server_key: "6f832216f04e9b988ee5b3c799894663"
server_key_iv: "94386cc005d27986fa2a198c7fb3de70"
server_key_version: "encryptionkey@0"
I20260811 00:50:36.933760 32556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:36.934446 32589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:36.934580 32556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:36.934665 32556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "21a14bffb4d04c7eaf0cdff032091b03"
format_stamp: "Formatted at 2026-08-11 00:50:36 on dist-test-slave-xt4k"
server_key: "6f832216f04e9b988ee5b3c799894663"
server_key_iv: "94386cc005d27986fa2a198c7fb3de70"
server_key_version: "encryptionkey@0"
I20260811 00:50:36.934727 32556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:36.946375 32556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:36.948114 32556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:36.948246 32556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:36.951917 32556 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:39097
I20260811 00:50:36.951954 32694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:39097 every 8 connection(s)
I20260811 00:50:36.952273 32556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:36.953436 32696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:36.955705 32696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03: Bootstrap starting.
I20260811 00:50:36.956228 32696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:36.956519 32696 log.cc:824] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:36.957185 32696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03: No bootstrap required, opened a new log
I20260811 00:50:36.958734 32696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } }
I20260811 00:50:36.958874 32696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:36.958905 32696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21a14bffb4d04c7eaf0cdff032091b03, State: Initialized, Role: FOLLOWER
I20260811 00:50:36.959005 32696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } }
I20260811 00:50:36.959056 32696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:36.959075 32696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:36.959107 32696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:36.959864 32696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } }
I20260811 00:50:36.959954 32696 leader_election.cc:302] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21a14bffb4d04c7eaf0cdff032091b03; no voters:
I20260811 00:50:36.960072 32696 leader_election.cc:288] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:36.960121 32700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:36.960290 32700 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [term 1 LEADER]: Becoming Leader. State: Replica: 21a14bffb4d04c7eaf0cdff032091b03, State: Running, Role: LEADER
I20260811 00:50:36.960297 32696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:36.960407 32700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } }
I20260811 00:50:36.960783 32703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21a14bffb4d04c7eaf0cdff032091b03. Latest consensus state: current_term: 1 leader_uuid: "21a14bffb4d04c7eaf0cdff032091b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } } }
I20260811 00:50:36.960793 32701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21a14bffb4d04c7eaf0cdff032091b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21a14bffb4d04c7eaf0cdff032091b03" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39097 } } }
I20260811 00:50:36.960942 32703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:36.960947 32701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:36.961193 32718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:36.961717 32718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:36.961716 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32556
I20260811 00:50:36.961822 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:36.961973 27022 external_mini_cluster.cc:1428] Setting key 45a9083cda64b1b2a4cf99edb3a36c49
I20260811 00:50:36.963403 32718 catalog_manager.cc:1347] Generated new cluster ID: 8ded4c55a9a949a3ac28af3d952e1ec5
I20260811 00:50:36.963451 32718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:36 dist-test-slave-xt4k krb5kdc[32532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:36.973467 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:36.962577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33868 (local address 127.26.99.190:39097)
0811 00:50:36.962859 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:36.962869 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:36.962903 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:50:36.963016 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:36.963023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:36.963081 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:36.963226 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:36.963991 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:36.965413 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:36.966519 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:36.967100 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:36.967196 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:36.969910 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:36.969914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:36.969914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:36.969926 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:36.971859 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:36.972229 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:36.972233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:36.972233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:36.972366 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:36.972542 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:36.972543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:36.972544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:36.972862 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:36.973027 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:36.973093 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 00:50:36.973235 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
I20260811 00:50:37.002359 32718 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:37.003144 32718 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:37.012470 32718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21a14bffb4d04c7eaf0cdff032091b03: Generated new TSK 0
I20260811 00:50:37.012693 32718 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:37.038712 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:37.121968 32745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:37.122179 32745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:37.122201 32745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:37.123386 32745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:37.123438 32745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:37.123464 32745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:37.124976 32745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:37.125204 32745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:37.125440 32745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:37.130445 32745 server_base.cc:1034] running on GCE node
W20260811 00:50:37.130424 32760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.130417 32755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.130424 32757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:37.130846 32745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:37.131108 32745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:37.132302 32745 hybrid_clock.cc:648] HybridClock initialized: now 1786409437132290 us; error 28 us; skew 500 ppm
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:37.135006 32745 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:37.135465 32745 webserver.cc:460] Webserver started at http://127.26.99.129:41627/ using document root <none> and password file <none>
I20260811 00:50:37.135668 32745 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:37.135717 32745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:37.135844 32745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:37.136971 32745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "3e017508245446489e3ec8658aeaf141"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "9fb446845353b578a818c63ea547aff0"
server_key_iv: "ff2ab6126f0ae09bca7b26f0a467b451"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.137322 32745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "3e017508245446489e3ec8658aeaf141"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "9fb446845353b578a818c63ea547aff0"
server_key_iv: "ff2ab6126f0ae09bca7b26f0a467b451"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.138622 32745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:37.139360 302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.139590 32745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:37.139689 32745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "3e017508245446489e3ec8658aeaf141"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "9fb446845353b578a818c63ea547aff0"
server_key_iv: "ff2ab6126f0ae09bca7b26f0a467b451"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.139753 32745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:37.147588 32745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:37.149740 32745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:37.149881 32745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:37.150086 32745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:37.150389 32745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:37.150424 32745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.150451 32745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:37.150468 32745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.155943 32745 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:41215
I20260811 00:50:37.155997 529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:41215 every 8 connection(s)
I20260811 00:50:37.156297 32745 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:37.164268 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32745
I20260811 00:50:37.164387 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:37.164577 27022 external_mini_cluster.cc:1428] Setting key b59e6cae79799f528232ec148f6d85da
I20260811 00:50:37.165263 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.157035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:55701 (local address 127.26.99.190:39097)
0811 00:50:37.157095 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:37.157098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:37.157266 (+ 168us) server_negotiation.cc:407] Connection header received
0811 00:50:37.157782 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:37.157783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:37.157796 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:37.157849 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:37.158782 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.159290 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.160314 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.160569 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.160626 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.162683 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:37.162684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:37.162685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:37.162693 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:37.163926 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.164285 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.164287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.164287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.164376 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.164599 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.164599 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.164600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.164713 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:37.164769 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:37.165073 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 00:50:37.165172 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:50:37.165403 533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.156972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39097 (local address 127.26.99.129:55701)
0811 00:50:37.157150 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:37.157189 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:37.157682 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:37.157917 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:37.157930 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:37.158496 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:37.158687 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.158692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.159375 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.159376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.160215 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.160218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.160642 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.160643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.160760 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.161215 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:37.161225 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:37.162590 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:37.164000 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.164007 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.164009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.164220 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.164427 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.164428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.164428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.164541 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.164810 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:37.164817 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:37.164949 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 00:50:37.165040 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 00:50:37.165197 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260811 00:50:37.167037 530 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39097
I20260811 00:50:37.167136 530 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:37.167315 530 heartbeater.cc:511] Master 127.26.99.190:39097 requested a full tablet report, sending...
I20260811 00:50:37.167852 32629 ts_manager.cc:194] Registered new tserver with Master: 3e017508245446489e3ec8658aeaf141 (127.26.99.129:41215)
I20260811 00:50:37.168502 32629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:55701
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:37.190753 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:37.271119 536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:37.271317 536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:37.271347 536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:37.272506 536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:37.272545 536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:37.272580 536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:37.274039 536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:37.274274 536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:37.274485 536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:37.279328 547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.279362 550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.279362 546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:37.279505 536 server_base.cc:1034] running on GCE node
I20260811 00:50:37.279719 536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:37.279934 536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:37.281080 536 hybrid_clock.cc:648] HybridClock initialized: now 1786409437281068 us; error 30 us; skew 500 ppm
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:37.286670 536 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:37.287081 536 webserver.cc:460] Webserver started at http://127.26.99.130:33943/ using document root <none> and password file <none>
I20260811 00:50:37.287304 536 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:37.287352 536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:37.287478 536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:37.288550 536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "49eb351c1b094a619168af05597fd6d3"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "22f737b457703d07dd39dfaee8e0e35c"
server_key_iv: "e5d76baf7e5295df40b2364f3f17b283"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.288877 536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "49eb351c1b094a619168af05597fd6d3"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "22f737b457703d07dd39dfaee8e0e35c"
server_key_iv: "e5d76baf7e5295df40b2364f3f17b283"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.290149 536 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:37.290830 562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.290987 536 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:37.291081 536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "49eb351c1b094a619168af05597fd6d3"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "22f737b457703d07dd39dfaee8e0e35c"
server_key_iv: "e5d76baf7e5295df40b2364f3f17b283"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.291142 536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:37.304826 536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:37.306926 536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:37.307039 536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:37.307227 536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:37.307528 536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:37.307561 536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.307591 536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:37.307615 536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.313196 536 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:33041
I20260811 00:50:37.313259 770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:33041 every 8 connection(s)
I20260811 00:50:37.313562 536 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:37.315765 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 536
I20260811 00:50:37.315855 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:37.316040 27022 external_mini_cluster.cc:1428] Setting key 08dd1d9e7d5a172df713f584c2cac976
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:37.323287 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.314354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:53907 (local address 127.26.99.190:39097)
0811 00:50:37.314405 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:37.314407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:37.314615 (+ 208us) server_negotiation.cc:407] Connection header received
0811 00:50:37.315124 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:37.315126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:37.315137 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:37.315194 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:37.316156 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.316790 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.317772 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.317976 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.318034 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.320328 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:37.320330 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:37.320330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:37.320370 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:37.321772 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.322249 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.322249 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.322250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.322296 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.322606 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.322607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.322607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.322750 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:37.322830 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:37.323104 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 00:50:37.323195 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:37.323453 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.314324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39097 (local address 127.26.99.130:53907)
0811 00:50:37.314495 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:37.314532 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:37.315011 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:37.315249 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:37.315253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:37.315838 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:37.316068 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.316074 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.316874 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.316875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.317688 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.317691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.318044 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.318046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.318178 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.318675 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:37.318683 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:37.320218 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:37.321855 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.321864 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.321866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.322167 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.322351 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.322352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.322352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.322513 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.322842 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:37.322849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:37.322975 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 00:50:37.323071 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:50:37.323232 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260811 00:50:37.324093 773 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39097
I20260811 00:50:37.324183 773 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:37.324393 773 heartbeater.cc:511] Master 127.26.99.190:39097 requested a full tablet report, sending...
I20260811 00:50:37.324828 32629 ts_manager.cc:194] Registered new tserver with Master: 49eb351c1b094a619168af05597fd6d3 (127.26.99.130:33041)
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
I20260811 00:50:37.325335 32629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:53907
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:37.341265 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:37.434206 788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:37.434544 788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:37.434598 788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:37.436244 788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:37.436295 788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:37.436353 788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:37.438496 788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:37.438750 788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:37.439023 788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:37.445194 797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.445199 802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:37.445200 798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:37.445384 788 server_base.cc:1034] running on GCE node
I20260811 00:50:37.445567 788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:37.445783 788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:37.446936 788 hybrid_clock.cc:648] HybridClock initialized: now 1786409437446923 us; error 28 us; skew 500 ppm
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:37.449419 788 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:37.449824 788 webserver.cc:460] Webserver started at http://127.26.99.131:35661/ using document root <none> and password file <none>
I20260811 00:50:37.450018 788 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:37.450066 788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:37.450193 788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:37.451195 788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "a29a586303e443a385cbef08481afc00"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "a9b93dbca491fd1803f12226d81440a8"
server_key_iv: "8e1a5c40647402328f32a2f5e115f733"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.451519 788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "a29a586303e443a385cbef08481afc00"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "a9b93dbca491fd1803f12226d81440a8"
server_key_iv: "8e1a5c40647402328f32a2f5e115f733"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.452797 788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:37.453482 818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.453656 788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:37.453739 788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "a29a586303e443a385cbef08481afc00"
format_stamp: "Formatted at 2026-08-11 00:50:37 on dist-test-slave-xt4k"
server_key: "a9b93dbca491fd1803f12226d81440a8"
server_key_iv: "8e1a5c40647402328f32a2f5e115f733"
server_key_version: "encryptionkey@0"
I20260811 00:50:37.453799 788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:37.462718 788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:37.464409 788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:37.464536 788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:37.464740 788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:37.465021 788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:37.465054 788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.465081 788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:37.465106 788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:37.470608 788 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:35901
I20260811 00:50:37.470669 1048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:35901 every 8 connection(s)
I20260811 00:50:37.471004 788 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:37.476276 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 788
I20260811 00:50:37.476397 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:37.476562 27022 external_mini_cluster.cc:1428] Setting key 839317968ebbd73229db080cf23e6a82
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:37.479781 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.471614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:41579 (local address 127.26.99.190:39097)
0811 00:50:37.471657 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:37.471659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:37.471855 (+ 196us) server_negotiation.cc:407] Connection header received
0811 00:50:37.472394 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:37.472396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:37.472410 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:37.472461 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:37.473419 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.473936 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.474922 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.475125 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.475184 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.477503 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:37.477504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:37.477504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:37.477511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:37.478556 (+ 1045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.478918 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.478919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.478919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.478970 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.479190 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.479191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.479192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.479299 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:37.479356 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:37.479611 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 00:50:37.479693 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:37.479947 1053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.471598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39097 (local address 127.26.99.131:41579)
0811 00:50:37.471740 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:37.471775 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:37.472274 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:37.472531 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:37.472535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:37.473103 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:37.473305 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.473310 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.474021 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.474022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.474836 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:37.474838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.475199 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.475200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:37.475324 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.475783 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:37.475791 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:37.477418 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:37.478636 (+ 1218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.478644 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.478646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.478850 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.479025 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:37.479026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:37.479026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:37.479134 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:37.479357 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:37.479364 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:37.479495 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 00:50:37.479581 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:50:37.479739 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260811 00:50:37.480351 1051 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39097
I20260811 00:50:37.480453 1051 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:37.480634 1051 heartbeater.cc:511] Master 127.26.99.190:39097 requested a full tablet report, sending...
I20260811 00:50:37.480996 32629 ts_manager.cc:194] Registered new tserver with Master: a29a586303e443a385cbef08481afc00 (127.26.99.131:35901)
I20260811 00:50:37.481348 32629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:41579
I20260811 00:50:37.488310 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[32532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409437, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:37.510886 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:37.504565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33878 (local address 127.26.99.190:39097)
0811 00:50:37.504618 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:37.504620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:37.504713 (+ 93us) server_negotiation.cc:407] Connection header received
0811 00:50:37.504769 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:37.504770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:37.504779 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:37.504840 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:37.505351 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.505839 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.506566 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:37.506763 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:37.506815 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:37.508848 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:37.508849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:37.508849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:37.508856 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:37.510067 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.510314 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.510315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.510315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.510360 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:37.510477 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:37.510477 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:37.510478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:37.510622 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:37.510693 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:37.510762 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:50:37.510820 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 00:50:37.511099 32629 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33878
I20260811 00:50:37.511741 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32745
I20260811 00:50:37.528963 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 536
I20260811 00:50:37.539793 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 788
I20260811 00:50:37.547796 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32556
2026-08-11T00:50:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2029 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[1067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[1067](info): set up 2 sockets
Aug 11 00:50:37 dist-test-slave-xt4k krb5kdc[1067](info): commencing operation
krb5kdc: starting...
W20260811 00:50:38.745049 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:38 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:38.867236 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38987
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:36743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:38987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:38.948778 1097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:38.948989 1097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:38.949010 1097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:38.950111 1097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:38.950143 1097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:38.950156 1097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:38.950168 1097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:38.950178 1097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:38.951670 1097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:38987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:38.951862 1097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:38.952045 1097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:38.956764 1097 server_base.cc:1034] running on GCE node
W20260811 00:50:38.956791 1112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:38.956775 1115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:38.956820 1119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:38.957209 1097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:38.957484 1097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:38.958639 1097 hybrid_clock.cc:648] HybridClock initialized: now 1786409438958627 us; error 32 us; skew 500 ppm
Aug 11 00:50:38 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409438, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:38.963732 1097 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:38.964172 1097 webserver.cc:460] Webserver started at http://127.26.99.190:45897/ using document root <none> and password file <none>
I20260811 00:50:38.964408 1097 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:38.964462 1097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:38.964602 1097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:38.965638 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "84a2cedb349046a285ccc0e41180fbd6"
format_stamp: "Formatted at 2026-08-11 00:50:38 on dist-test-slave-xt4k"
server_key: "0520f8b7f067e267d9b69adab9d287d9"
server_key_iv: "9d8a344dc35de9417081616d808064f7"
server_key_version: "encryptionkey@0"
I20260811 00:50:38.965977 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "84a2cedb349046a285ccc0e41180fbd6"
format_stamp: "Formatted at 2026-08-11 00:50:38 on dist-test-slave-xt4k"
server_key: "0520f8b7f067e267d9b69adab9d287d9"
server_key_iv: "9d8a344dc35de9417081616d808064f7"
server_key_version: "encryptionkey@0"
I20260811 00:50:38.967264 1097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:38.967974 1129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:38.968118 1097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:38.968214 1097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "84a2cedb349046a285ccc0e41180fbd6"
format_stamp: "Formatted at 2026-08-11 00:50:38 on dist-test-slave-xt4k"
server_key: "0520f8b7f067e267d9b69adab9d287d9"
server_key_iv: "9d8a344dc35de9417081616d808064f7"
server_key_version: "encryptionkey@0"
I20260811 00:50:38.968272 1097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:38.994282 1097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:38.996455 1097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:38.996615 1097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:39.000424 1097 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:38987
I20260811 00:50:39.000479 1234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:38987 every 8 connection(s)
I20260811 00:50:39.000952 1097 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:39.001634 1235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:39.002393 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1097
I20260811 00:50:39.002516 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:39.002678 27022 external_mini_cluster.cc:1428] Setting key 2f0ad29dda4dc84df39cb0f093f8adf3
I20260811 00:50:39.004776 1235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6: Bootstrap starting.
I20260811 00:50:39.005498 1235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:39.005792 1235 log.cc:824] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:39.006526 1235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6: No bootstrap required, opened a new log
I20260811 00:50:39.008846 1235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } }
I20260811 00:50:39.009028 1235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:39.009075 1235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84a2cedb349046a285ccc0e41180fbd6, State: Initialized, Role: FOLLOWER
I20260811 00:50:39.009217 1235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } }
I20260811 00:50:39.009307 1235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:39.009333 1235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:39.009380 1235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:39.009948 1235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } }
I20260811 00:50:39.010041 1235 leader_election.cc:302] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84a2cedb349046a285ccc0e41180fbd6; no voters:
I20260811 00:50:39.010201 1235 leader_election.cc:288] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:39.010231 1243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:39.010370 1243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [term 1 LEADER]: Becoming Leader. State: Replica: 84a2cedb349046a285ccc0e41180fbd6, State: Running, Role: LEADER
I20260811 00:50:39.010480 1235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:39.010505 1243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } }
I20260811 00:50:39.011008 1244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84a2cedb349046a285ccc0e41180fbd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } } }
I20260811 00:50:39.011045 1245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84a2cedb349046a285ccc0e41180fbd6. Latest consensus state: current_term: 1 leader_uuid: "84a2cedb349046a285ccc0e41180fbd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84a2cedb349046a285ccc0e41180fbd6" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38987 } } }
I20260811 00:50:39.011214 1245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:39.011576 1244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:39.012390 1262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:39.012890 1262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:39.014432 1262 catalog_manager.cc:1347] Generated new cluster ID: 1bf5f2eedee24fb9b5aedebb47da778a
I20260811 00:50:39.014478 1262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:39.014485 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.003175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.26.99.190:38987)
0811 00:50:39.003367 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.003376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.003409 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:50:39.003925 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.003935 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.004012 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.004156 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.004772 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.006129 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.007139 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.007582 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.007663 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.010200 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.010205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.010206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.010216 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.012450 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.012789 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.012792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.012792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.012900 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.013142 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.013143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.013143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.013466 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.014063 (+ 597us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.014141 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.014287 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
I20260811 00:50:39.019025 1262 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:39.019711 1262 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:39.024788 1262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84a2cedb349046a285ccc0e41180fbd6: Generated new TSK 0
I20260811 00:50:39.024958 1262 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:39.055259 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:36743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:39.138130 1284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:39.138351 1284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:39.138384 1284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:39.139726 1284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:39.139789 1284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:39.139829 1284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:39.141568 1284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:39.141812 1284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:39.142031 1284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:39.146893 1299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:39.146898 1295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:39.146957 1293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:39.147451 1284 server_base.cc:1034] running on GCE node
I20260811 00:50:39.147680 1284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:39.147891 1284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:39.149053 1284 hybrid_clock.cc:648] HybridClock initialized: now 1786409439149037 us; error 50 us; skew 500 ppm
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:39.151731 1284 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:39.152181 1284 webserver.cc:460] Webserver started at http://127.26.99.129:38989/ using document root <none> and password file <none>
I20260811 00:50:39.152436 1284 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:39.152523 1284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:39.152652 1284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:39.153867 1284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "3e111f6fcb9c4fcb8ad3af41f3c2aa73"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "32c616a445d4226fbcdd48bc9d0314d9"
server_key_iv: "388b3cb86edae98ea086c4363c63e711"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.154211 1284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "3e111f6fcb9c4fcb8ad3af41f3c2aa73"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "32c616a445d4226fbcdd48bc9d0314d9"
server_key_iv: "388b3cb86edae98ea086c4363c63e711"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.155619 1284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:39.156594 1313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.156798 1284 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:39.156894 1284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "3e111f6fcb9c4fcb8ad3af41f3c2aa73"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "32c616a445d4226fbcdd48bc9d0314d9"
server_key_iv: "388b3cb86edae98ea086c4363c63e711"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.156960 1284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:39.174137 1284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:39.176438 1284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:39.176601 1284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:39.176856 1284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:39.177170 1284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:39.177204 1284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.177234 1284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:39.177258 1284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.183151 1284 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:46035
I20260811 00:50:39.183215 1534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:46035 every 8 connection(s)
I20260811 00:50:39.183522 1284 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:39.190977 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1284
I20260811 00:50:39.191071 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:39.191262 27022 external_mini_cluster.cc:1428] Setting key 18ec3c8e6ffe084596f76296b7293ef3
I20260811 00:50:39.194491 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.184331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:36505 (local address 127.26.99.190:38987)
0811 00:50:39.184418 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.184420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.184566 (+ 146us) server_negotiation.cc:407] Connection header received
0811 00:50:39.185994 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.185996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.186011 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.186062 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.186778 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.187297 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.188297 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.188557 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.188614 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.190869 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.190870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.190871 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.190879 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.192663 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.193358 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.193359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.193360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.193410 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.193701 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.193702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.193703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.193839 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.193901 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.194284 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.194396 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 00:50:39.194587 1538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.184253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38987 (local address 127.26.99.129:36505)
0811 00:50:39.184432 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:39.184481 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:39.185851 (+ 1370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:39.186151 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:39.186155 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:39.186460 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:39.186676 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.186682 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.187387 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.187388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.188207 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.188209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.188643 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.188644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.188774 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.189303 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:39.189312 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:39.190739 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:39.192829 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.192926 (+ 97us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.192934 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.193280 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.193471 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.193471 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.193472 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.193612 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.193905 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:39.193912 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:39.194108 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 00:50:39.194235 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 00:50:39.194394 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260811 00:50:39.195278 1536 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38987
I20260811 00:50:39.195379 1536 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:39.195587 1536 heartbeater.cc:511] Master 127.26.99.190:38987 requested a full tablet report, sending...
I20260811 00:50:39.196171 1162 ts_manager.cc:194] Registered new tserver with Master: 3e111f6fcb9c4fcb8ad3af41f3c2aa73 (127.26.99.129:46035)
I20260811 00:50:39.196822 1162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:36505
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:39.216607 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:36743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:39.298997 1544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:39.299209 1544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:39.299232 1544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:39.300441 1544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:39.300482 1544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:39.300508 1544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:39.302071 1544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:39.302310 1544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:39.302538 1544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:39.307448 1561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:39.307412 1559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:39.307595 1544 server_base.cc:1034] running on GCE node
W20260811 00:50:39.307420 1558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:39.307864 1544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:39.308079 1544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:39.309237 1544 hybrid_clock.cc:648] HybridClock initialized: now 1786409439309222 us; error 29 us; skew 500 ppm
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:39.311880 1544 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:39.312307 1544 webserver.cc:460] Webserver started at http://127.26.99.130:40561/ using document root <none> and password file <none>
I20260811 00:50:39.312574 1544 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:39.312628 1544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:39.312757 1544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:39.313822 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "cc4b42069ac046678b10d55ee558b676"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "a24628adfd87f893ad28d78c637446ef"
server_key_iv: "64a422442744349af018ee5537693991"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.314248 1544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "cc4b42069ac046678b10d55ee558b676"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "a24628adfd87f893ad28d78c637446ef"
server_key_iv: "64a422442744349af018ee5537693991"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.315506 1544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:39.316159 1575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.316321 1544 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:39.316431 1544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "cc4b42069ac046678b10d55ee558b676"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "a24628adfd87f893ad28d78c637446ef"
server_key_iv: "64a422442744349af018ee5537693991"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.316493 1544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:39.328953 1544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:39.330681 1544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:39.330806 1544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:39.331019 1544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:39.331303 1544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:39.331336 1544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.331363 1544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:39.331386 1544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.337150 1544 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39727
I20260811 00:50:39.337189 1791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39727 every 8 connection(s)
I20260811 00:50:39.337474 1544 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:39.341918 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1544
I20260811 00:50:39.342017 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:39.342199 27022 external_mini_cluster.cc:1428] Setting key 886c0287d7add2b98702fda6495e6cc5
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:39.347059 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.338260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:60657 (local address 127.26.99.190:38987)
0811 00:50:39.338313 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.338315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.338496 (+ 181us) server_negotiation.cc:407] Connection header received
0811 00:50:39.339438 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.339440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.339452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.339504 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.340101 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.340636 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.341660 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.341848 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.341904 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.344372 (+ 2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.344373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.344373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.344380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.345723 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.346097 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.346098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.346099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.346163 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.346360 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.346361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.346361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.346489 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.346562 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.346876 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.346966 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:39.347108 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.338228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38987 (local address 127.26.99.130:60657)
0811 00:50:39.338386 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:39.338421 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:39.339335 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:39.339574 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:39.339578 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:39.339831 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:39.340012 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.340016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.340727 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.340728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.341564 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.341567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.341918 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.341919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.342060 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.342565 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:39.342575 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:39.344257 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:39.345796 (+ 1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.345803 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.345805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.346025 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.346224 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.346224 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.346224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.346311 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.346576 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:39.346583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:39.346724 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 00:50:39.346819 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:50:39.346952 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260811 00:50:39.347572 1792 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38987
I20260811 00:50:39.347661 1792 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:39.347826 1792 heartbeater.cc:511] Master 127.26.99.190:38987 requested a full tablet report, sending...
I20260811 00:50:39.348187 1162 ts_manager.cc:194] Registered new tserver with Master: cc4b42069ac046678b10d55ee558b676 (127.26.99.130:39727)
I20260811 00:50:39.348557 1162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:60657
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:39.367442 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:36743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:39.447364 1803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:39.447556 1803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:39.447576 1803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:39.448705 1803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:39.448745 1803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:39.448773 1803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:39.450214 1803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38987
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:39.450418 1803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:39.450626 1803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:39.455466 1813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:39.455492 1818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:39.455509 1816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:39.455663 1803 server_base.cc:1034] running on GCE node
I20260811 00:50:39.455931 1803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:39.456154 1803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:39.457316 1803 hybrid_clock.cc:648] HybridClock initialized: now 1786409439457293 us; error 39 us; skew 500 ppm
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:39.459744 1803 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:39.460170 1803 webserver.cc:460] Webserver started at http://127.26.99.131:43315/ using document root <none> and password file <none>
I20260811 00:50:39.460379 1803 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:39.460424 1803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:39.460517 1803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:39.461485 1803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "4a944034a3fa4c3ba3d9c464edc22a7e"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "d27c0ada437d389001f00b9d15c924f0"
server_key_iv: "c1f47f4af967a138b8451d0e2b90bbcc"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.461771 1803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "4a944034a3fa4c3ba3d9c464edc22a7e"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "d27c0ada437d389001f00b9d15c924f0"
server_key_iv: "c1f47f4af967a138b8451d0e2b90bbcc"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.463016 1803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:39.463613 1832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.463740 1803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:39.463819 1803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "4a944034a3fa4c3ba3d9c464edc22a7e"
format_stamp: "Formatted at 2026-08-11 00:50:39 on dist-test-slave-xt4k"
server_key: "d27c0ada437d389001f00b9d15c924f0"
server_key_iv: "c1f47f4af967a138b8451d0e2b90bbcc"
server_key_version: "encryptionkey@0"
I20260811 00:50:39.463883 1803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:39.479717 1803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:39.481472 1803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:39.481590 1803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:39.481803 1803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:39.482103 1803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:39.482136 1803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.482164 1803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:39.482188 1803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:39.487565 1803 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39539
I20260811 00:50:39.487609 2047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39539 every 8 connection(s)
I20260811 00:50:39.487895 1803 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:39.492656 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1803
I20260811 00:50:39.492779 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:39.492980 27022 external_mini_cluster.cc:1428] Setting key f85620f0695712ba2bda21b73fe30eda
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:39.496641 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.488603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:60315 (local address 127.26.99.190:38987)
0811 00:50:39.488648 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.488650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.488830 (+ 180us) server_negotiation.cc:407] Connection header received
0811 00:50:39.489767 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.489769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.489780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.489848 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.490463 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.490973 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.491892 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.492092 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.492143 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.494285 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.494286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.494286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.494292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.495576 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.495889 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.495890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.495891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.495942 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.496120 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.496120 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.496120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.496215 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.496259 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.496501 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.496577 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:39.496766 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.488554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38987 (local address 127.26.99.131:60315)
0811 00:50:39.488721 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:39.488761 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:39.489655 (+ 894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:39.489940 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:39.489944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:39.490193 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:39.490378 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.490382 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.491040 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.491040 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.491819 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:39.491820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.492173 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.492174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:39.492276 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.492833 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:39.492843 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:39.494198 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:39.495636 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.495639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.495640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.495828 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.495990 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:39.495991 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:39.495991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:39.496080 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:39.496256 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:39.496258 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:39.496398 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:50:39.496475 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:50:39.496595 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260811 00:50:39.497212 2050 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38987
I20260811 00:50:39.497305 2050 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:39.497479 2050 heartbeater.cc:511] Master 127.26.99.190:38987 requested a full tablet report, sending...
I20260811 00:50:39.497836 1162 ts_manager.cc:194] Registered new tserver with Master: 4a944034a3fa4c3ba3d9c464edc22a7e (127.26.99.131:39539)
I20260811 00:50:39.498188 1162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:60315
I20260811 00:50:39.504537 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:39.527030 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.520174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.26.99.129:46035)
0811 00:50:39.520368 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.520374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.520385 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:39.520412 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.520414 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.520428 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.520510 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.520996 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.521725 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.522397 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.522707 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.522756 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.524703 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.524711 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.524711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.524718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.526109 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.526407 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.526409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.526409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.526473 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.526605 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.526606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.526606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.526725 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.526830 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.526871 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.526932 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[1067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:39.534065 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:39.528226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.26.99.190:38987)
0811 00:50:39.528269 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:39.528270 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:39.528278 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:39.528302 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:39.528303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:39.528311 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:39.528391 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:39.528794 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.529262 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.529901 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:39.530087 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:39.530141 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:39.531959 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:39.531960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:39.531960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:39.531967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:39.533171 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.533465 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.533466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.533466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.533536 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:39.533667 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:39.533667 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:39.533667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:39.533795 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:39.533861 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:39.533933 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:50:39.533995 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 00:50:39.534278 1162 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53278
I20260811 00:50:39.534576 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1284
I20260811 00:50:39.545773 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1544
I20260811 00:50:39.555821 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1803
I20260811 00:50:39.568284 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1097
2026-08-11T00:50:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2021 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[2067](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[2067](info): set up 2 sockets
Aug 11 00:50:39 dist-test-slave-xt4k krb5kdc[2067](info): commencing operation
krb5kdc: starting...
W20260811 00:50:40.758109 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:40 dist-test-slave-xt4k krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:40.875504 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37535
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37535
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:40.956457 2093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:40.956663 2093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:40.956692 2093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:40.957823 2093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:40.957862 2093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:40.957880 2093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:40.957897 2093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:40.957913 2093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:40.959427 2093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37535
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:40.959666 2093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:40.959869 2093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:40.964665 2111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:40.964704 2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:40.964740 2093 server_base.cc:1034] running on GCE node
W20260811 00:50:40.964704 2102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:40.965072 2093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:40.965355 2093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:40.966535 2093 hybrid_clock.cc:648] HybridClock initialized: now 1786409440966515 us; error 30 us; skew 500 ppm
Aug 11 00:50:40 dist-test-slave-xt4k krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409440, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:40.968983 2093 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:40.969276 2093 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:40.969326 2093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:40.969447 2093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:40.970443 2093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "4fce988d98eb491999a55eddc51f0df7"
format_stamp: "Formatted at 2026-08-11 00:50:40 on dist-test-slave-xt4k"
server_key: "cfc04ce40b5bb420968783bee520cc18"
server_key_iv: "c4cb89f3b7ccf54619fc61ebc1f04dbc"
server_key_version: "encryptionkey@0"
I20260811 00:50:40.970762 2093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "4fce988d98eb491999a55eddc51f0df7"
format_stamp: "Formatted at 2026-08-11 00:50:40 on dist-test-slave-xt4k"
server_key: "cfc04ce40b5bb420968783bee520cc18"
server_key_iv: "c4cb89f3b7ccf54619fc61ebc1f04dbc"
server_key_version: "encryptionkey@0"
I20260811 00:50:40.971918 2093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:40.972579 2127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:40.972729 2093 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:40.972812 2093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "4fce988d98eb491999a55eddc51f0df7"
format_stamp: "Formatted at 2026-08-11 00:50:40 on dist-test-slave-xt4k"
server_key: "cfc04ce40b5bb420968783bee520cc18"
server_key_iv: "c4cb89f3b7ccf54619fc61ebc1f04dbc"
server_key_version: "encryptionkey@0"
I20260811 00:50:40.972869 2093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:40.989666 2093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:40.991293 2093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:40.991413 2093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:40.995101 2093 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37535
I20260811 00:50:40.995123 2229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37535 every 8 connection(s)
I20260811 00:50:40.995366 2093 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:40.996428 2230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:40.998613 2230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: Bootstrap starting.
I20260811 00:50:40.999186 2230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:40.999467 2230 log.cc:824] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:41.000157 2230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: No bootstrap required, opened a new log
I20260811 00:50:41.000571 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2093
I20260811 00:50:41.000679 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:41.000839 27022 external_mini_cluster.cc:1428] Setting key e5ea66ce21719e0abcada994cf0ae632
I20260811 00:50:41.002171 2230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } }
I20260811 00:50:41.002337 2230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:41.002429 2230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fce988d98eb491999a55eddc51f0df7, State: Initialized, Role: FOLLOWER
I20260811 00:50:41.002593 2230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } }
I20260811 00:50:41.002679 2230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:41.002736 2230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:41.002785 2230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:41.003422 2230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } }
I20260811 00:50:41.003533 2230 leader_election.cc:302] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fce988d98eb491999a55eddc51f0df7; no voters:
I20260811 00:50:41.003690 2230 leader_election.cc:288] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:41.003737 2239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:41.003876 2239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [term 1 LEADER]: Becoming Leader. State: Replica: 4fce988d98eb491999a55eddc51f0df7, State: Running, Role: LEADER
I20260811 00:50:41.003930 2230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:41.004063 2239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } }
I20260811 00:50:41.004442 2241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fce988d98eb491999a55eddc51f0df7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } } }
I20260811 00:50:41.004455 2240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fce988d98eb491999a55eddc51f0df7. Latest consensus state: current_term: 1 leader_uuid: "4fce988d98eb491999a55eddc51f0df7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fce988d98eb491999a55eddc51f0df7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37535 } } }
I20260811 00:50:41.004638 2240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:41.004848 2258 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:41.004640 2241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:41.005403 2258 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:41.006928 2258 catalog_manager.cc:1347] Generated new cluster ID: c0ea5453803047cc87fc5f6e734980a9
I20260811 00:50:41.006973 2258 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:41.012713 2258 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:41.013190 2258 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:41.014803 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.001308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36790 (local address 127.26.99.190:37535)
0811 00:50:41.001498 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.001507 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.001542 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:50:41.002141 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.002151 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.002214 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.002361 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.003040 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.004390 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.005432 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.006073 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.006177 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.010705 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.010709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.010709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:41.010721 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.013137 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.013527 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.013530 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.013531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.013638 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.013822 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.013823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.013823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.014108 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.014262 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.014331 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.014592 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260811 00:50:41.016239 2258 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: Generated new TSK 0
I20260811 00:50:41.016424 2258 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:41.044620 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:41.124810 2276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:41.125002 2276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:41.125034 2276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:41.126148 2276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:41.126188 2276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:41.126223 2276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:41.127708 2276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:41.127943 2276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:41.128140 2276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:41.132858 2290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.132869 2287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.132930 2293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:41.133240 2276 server_base.cc:1034] running on GCE node
I20260811 00:50:41.133438 2276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:41.133679 2276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:41.134816 2276 hybrid_clock.cc:648] HybridClock initialized: now 1786409441134802 us; error 31 us; skew 500 ppm
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:41.137113 2276 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:41.137408 2276 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:41.137454 2276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:41.137574 2276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:41.138572 2276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "363cfe294034ae1199f86f639e59330a"
server_key_iv: "553cec1971ce17c4c763365019add3d7"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.138926 2276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "363cfe294034ae1199f86f639e59330a"
server_key_iv: "553cec1971ce17c4c763365019add3d7"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.140074 2276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:41.140756 2302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.140900 2276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.140981 2276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "363cfe294034ae1199f86f639e59330a"
server_key_iv: "553cec1971ce17c4c763365019add3d7"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.141041 2276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:41.158533 2276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:41.160228 2276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:41.160432 2276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:41.160655 2276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:41.160954 2276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:41.160988 2276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.161016 2276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:41.161041 2276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.166529 2276 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:32901
I20260811 00:50:41.166584 2526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:32901 every 8 connection(s)
I20260811 00:50:41.166826 2276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:41.169355 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2276
I20260811 00:50:41.169471 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:41.169659 27022 external_mini_cluster.cc:1428] Setting key 1c16d4036a1e843bb3d24549b4731920
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:41.176223 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.167474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:37249 (local address 127.26.99.190:37535)
0811 00:50:41.167522 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.167524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.167695 (+ 171us) server_negotiation.cc:407] Connection header received
0811 00:50:41.168171 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.168172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.168181 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.168232 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.169276 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.169980 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.171043 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.171305 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.171373 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.173467 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.173468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.173469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:41.173477 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.174869 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.175273 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.175274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.175275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.175335 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.175615 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.175616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.175616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.175729 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.175779 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.176084 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.176159 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:41.176477 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.167417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37535 (local address 127.26.99.129:37249)
0811 00:50:41.167589 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.167629 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.168096 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.168287 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.168290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.168566 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:41.169180 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.169187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.170058 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.170059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.170953 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.170956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.171374 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.171375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.171467 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.171905 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:41.171916 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:41.173374 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:41.174946 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.174954 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.174956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.175179 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.175405 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.175405 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.175406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.175540 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.175785 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:41.175791 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:41.175953 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.176067 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.176233 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260811 00:50:41.176939 2530 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37535
I20260811 00:50:41.177033 2530 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:41.177181 2530 heartbeater.cc:511] Master 127.26.99.190:37535 requested a full tablet report, sending...
I20260811 00:50:41.177675 2160 ts_manager.cc:194] Registered new tserver with Master: 2fbca016a0ea4ef2a53e7fddb08a5adc (127.26.99.129:32901)
I20260811 00:50:41.178257 2160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:37249
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:41.194914 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:41.276152 2542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:41.276376 2542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:41.276401 2542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:41.277524 2542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:41.277557 2542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:41.277590 2542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:41.279057 2542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:41.279282 2542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:41.279477 2542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:41.284397 2564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.284404 2561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.284442 2555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:41.284524 2542 server_base.cc:1034] running on GCE node
I20260811 00:50:41.284793 2542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:41.285010 2542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:41.286170 2542 hybrid_clock.cc:648] HybridClock initialized: now 1786409441286157 us; error 30 us; skew 500 ppm
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:41.288619 2542 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:41.288920 2542 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:41.288964 2542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:41.289057 2542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:41.290027 2542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "08b388bd59604db090e732a7104a7640"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "341eba82aa879021da811ca86fb9fcbd"
server_key_iv: "f41f9b5628e4deeb094faf471cfc16ba"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.290333 2542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "08b388bd59604db090e732a7104a7640"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "341eba82aa879021da811ca86fb9fcbd"
server_key_iv: "f41f9b5628e4deeb094faf471cfc16ba"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.291492 2542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:41.292132 2576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.292285 2542 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.292393 2542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "08b388bd59604db090e732a7104a7640"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "341eba82aa879021da811ca86fb9fcbd"
server_key_iv: "f41f9b5628e4deeb094faf471cfc16ba"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.292456 2542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:41.299991 2542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:41.301632 2542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:41.301733 2542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:41.301898 2542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:41.302178 2542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:41.302210 2542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.302230 2542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:41.302253 2542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.307762 2542 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:45515
I20260811 00:50:41.307816 2810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:45515 every 8 connection(s)
I20260811 00:50:41.308046 2542 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:41.309751 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2542
I20260811 00:50:41.309847 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:41.310017 27022 external_mini_cluster.cc:1428] Setting key 1e3490a880adba0bf0ab36824593d697
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:41.317081 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.308732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37949 (local address 127.26.99.190:37535)
0811 00:50:41.308788 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.308790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.308990 (+ 200us) server_negotiation.cc:407] Connection header received
0811 00:50:41.309465 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.309466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.309475 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.309527 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.310607 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.311142 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.312116 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.312421 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.312478 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.314570 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.314572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.314572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:41.314579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.315804 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.316166 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.316167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.316168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.316223 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.316495 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.316496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.316497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.316609 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.316665 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.316912 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.316992 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:41.317250 2818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.308710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37535 (local address 127.26.99.130:37949)
0811 00:50:41.308873 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.308913 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.309365 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.309579 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.309581 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.309846 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:41.310513 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.310519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.311229 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.311230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.312021 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.312024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.312496 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.312497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.312635 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.313099 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:41.313109 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:41.314486 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:41.315877 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.315884 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.315886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.316100 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.316276 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.316277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.316277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.316438 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.316664 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:41.316670 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:41.316798 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.316884 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.317043 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260811 00:50:41.317836 2812 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37535
I20260811 00:50:41.317929 2812 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:41.318071 2812 heartbeater.cc:511] Master 127.26.99.190:37535 requested a full tablet report, sending...
I20260811 00:50:41.318435 2160 ts_manager.cc:194] Registered new tserver with Master: 08b388bd59604db090e732a7104a7640 (127.26.99.130:45515)
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
I20260811 00:50:41.318929 2160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:37949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:41.334998 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:41.415467 2827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:41.415660 2827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:41.415681 2827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:41.416771 2827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:41.416802 2827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:41.416827 2827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:41.418256 2827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:41.418434 2827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:41.418613 2827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:41.423261 2835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.423280 2836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.423264 2839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:41.423372 2827 server_base.cc:1034] running on GCE node
I20260811 00:50:41.423625 2827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:41.423811 2827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:41.424955 2827 hybrid_clock.cc:648] HybridClock initialized: now 1786409441424940 us; error 27 us; skew 500 ppm
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:41.427302 2827 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:41.427585 2827 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:41.427629 2827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:41.427721 2827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:41.428723 2827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "e9164366daab48e29c411fea408dfa3b"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "66d60453d9d4b623230d3eabad0fef61"
server_key_iv: "ce45c70169f124ce33e0b384e32e2b72"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.428997 2827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "e9164366daab48e29c411fea408dfa3b"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "66d60453d9d4b623230d3eabad0fef61"
server_key_iv: "ce45c70169f124ce33e0b384e32e2b72"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.430116 2827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:41.430728 2848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.430877 2827 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:41.430954 2827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "e9164366daab48e29c411fea408dfa3b"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "66d60453d9d4b623230d3eabad0fef61"
server_key_iv: "ce45c70169f124ce33e0b384e32e2b72"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.431015 2827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:41.437897 2827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:41.439409 2827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:41.439522 2827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:41.439698 2827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:41.439965 2827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:41.439996 2827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.440014 2827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:41.440037 2827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.445497 2827 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39295
I20260811 00:50:41.445559 3069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39295 every 8 connection(s)
I20260811 00:50:41.445755 2827 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:41.449559 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2827
I20260811 00:50:41.449672 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:41.449872 27022 external_mini_cluster.cc:1428] Setting key 4cfc2e79f3fe9c09092714818725c54b
Aug 11 00:50:41 dist-test-slave-xt4k krb5kdc[2067](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409441, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:41.454247 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.446480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:52007 (local address 127.26.99.190:37535)
0811 00:50:41.446554 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.446556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.446692 (+ 136us) server_negotiation.cc:407] Connection header received
0811 00:50:41.447192 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.447193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.447206 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.447253 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.448149 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.448711 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.449817 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.450055 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.450132 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.452137 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.452138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.452138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:41.452145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.453241 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.453562 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.453563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.453563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.453609 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.453793 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.453793 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.453793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.453885 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.453930 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.454122 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.454185 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:50:41.454392 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.446404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37535 (local address 127.26.99.131:52007)
0811 00:50:41.446570 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.446614 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.447092 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.447330 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.447333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.447580 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:41.448054 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.448059 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.448793 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.448794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.449729 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.449732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.450140 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.450141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.450271 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.450741 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:41.450749 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:41.452054 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:41.453306 (+ 1252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.453312 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.453314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.453506 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.453661 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:41.453662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:41.453662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:41.453750 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:41.453926 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:41.453929 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:41.454029 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.454104 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.454212 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260811 00:50:41.454815 3070 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37535
I20260811 00:50:41.454900 3070 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:41.455042 3070 heartbeater.cc:511] Master 127.26.99.190:37535 requested a full tablet report, sending...
I20260811 00:50:41.455361 2160 ts_manager.cc:194] Registered new tserver with Master: e9164366daab48e29c411fea408dfa3b (127.26.99.131:39295)
I20260811 00:50:41.455713 2160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:52007
I20260811 00:50:41.461390 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:41.467854 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.462676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36800 (local address 127.26.99.190:37535)
0811 00:50:41.462735 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.462737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.462808 (+ 71us) server_negotiation.cc:407] Connection header received
0811 00:50:41.462867 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.462868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.462877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.462921 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.463435 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.463878 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.464587 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.464766 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.464818 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.465847 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.465849 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.465849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:41.465855 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.466887 (+ 1032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.467170 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.467171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.467172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.467220 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:41.467375 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:41.467375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:41.467376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:41.467499 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.467584 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.467705 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.467772 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:50:41.469151 2160 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:41.470633 2160 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:41.476876 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.473020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42298 (local address 127.26.99.130:45515)
0811 00:50:41.473184 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.473188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.473199 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:41.473238 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.473240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.473255 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.473503 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:41.473594 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474687 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.475912 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476488 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476544 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476605 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.476754 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.476794 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260811 00:50:41.476876 3084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.472596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:45515 (local address 127.0.0.1:42298)
0811 00:50:41.472731 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.472769 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.472833 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.473363 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.473364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.473367 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:41.473424 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.473425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474821 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.474822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.475822 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.475824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476565 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.476656 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476668 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.476728 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.476780 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260811 00:50:41.477027 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.473241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50652 (local address 127.26.99.131:39295)
0811 00:50:41.473396 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.473401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.473565 (+ 164us) server_negotiation.cc:407] Connection header received
0811 00:50:41.473603 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.473605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.473620 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.473692 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:41.473813 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474813 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.475745 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476508 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476576 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476631 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.476920 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.476956 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260811 00:50:41.477041 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.472746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.26.99.129:32901)
0811 00:50:41.472887 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.472892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.473063 (+ 171us) server_negotiation.cc:407] Connection header received
0811 00:50:41.473135 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.473137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.473152 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.473388 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:41.473479 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474289 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.475856 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476578 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476636 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476684 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.476920 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.476970 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260811 00:50:41.477234 3081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.472874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39295 (local address 127.0.0.1:50652)
0811 00:50:41.473460 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.473469 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.473516 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.473707 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.473708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.473710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:41.473746 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.473747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474907 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.474908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.475665 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.475668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476669 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.476731 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476735 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.476781 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.476823 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":79,"threads_started":1}
I20260811 00:50:41.477236 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.472631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:32901 (local address 127.0.0.1:43116)
0811 00:50:41.472999 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.473007 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.473058 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.473234 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.473237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.473240 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:41.473302 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.473304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.474368 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.474369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.475771 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.475774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.476712 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.476713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.476770 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.476773 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.476814 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.476844 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260811 00:50:41.477913 2937 tablet_service.cc:1467] Processing CreateTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 (DEFAULT_TABLE table=test-table [id=83ec9f50afcf4e888b104bcd26f830de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:41.477910 2678 tablet_service.cc:1467] Processing CreateTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 (DEFAULT_TABLE table=test-table [id=83ec9f50afcf4e888b104bcd26f830de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:41.478214 2937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c770fad8ed9945bd802fd8a4aa032a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:41.478222 2678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c770fad8ed9945bd802fd8a4aa032a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:41.480680 3093 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Bootstrap starting.
I20260811 00:50:41.480759 2401 tablet_service.cc:1467] Processing CreateTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 (DEFAULT_TABLE table=test-table [id=83ec9f50afcf4e888b104bcd26f830de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:41.480922 3094 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Bootstrap starting.
I20260811 00:50:41.481098 2401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c770fad8ed9945bd802fd8a4aa032a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:41.481257 3093 tablet_bootstrap.cc:654] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:41.481678 3094 tablet_bootstrap.cc:654] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:41.481859 3093 log.cc:824] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:41.482267 3094 log.cc:824] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:41.482529 3093 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: No bootstrap required, opened a new log
I20260811 00:50:41.482601 3093 ts_tablet_manager.cc:1397] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:41.483073 3094 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: No bootstrap required, opened a new log
I20260811 00:50:41.483145 3094 ts_tablet_manager.cc:1397] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:41.484321 3101 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: Bootstrap starting.
I20260811 00:50:41.484285 3093 raft_consensus.cc:348] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.484472 3093 raft_consensus.cc:374] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:41.484517 3093 raft_consensus.cc:729] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9164366daab48e29c411fea408dfa3b, State: Initialized, Role: FOLLOWER
I20260811 00:50:41.484642 3093 consensus_queue.cc:260] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.484925 3093 ts_tablet_manager.cc:1428] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:41.484956 3070 heartbeater.cc:503] Master 127.26.99.190:37535 was elected leader, sending a full tablet report...
I20260811 00:50:41.485001 3101 tablet_bootstrap.cc:654] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:41.485163 3094 raft_consensus.cc:348] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.485333 3094 raft_consensus.cc:374] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:41.485376 3094 raft_consensus.cc:729] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b388bd59604db090e732a7104a7640, State: Initialized, Role: FOLLOWER
I20260811 00:50:41.485495 3094 consensus_queue.cc:260] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.485531 3101 log.cc:824] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:41.485767 3094 ts_tablet_manager.cc:1428] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:41.485802 2812 heartbeater.cc:503] Master 127.26.99.190:37535 was elected leader, sending a full tablet report...
I20260811 00:50:41.486274 3101 tablet_bootstrap.cc:492] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: No bootstrap required, opened a new log
I20260811 00:50:41.486343 3101 ts_tablet_manager.cc:1397] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:50:41.487686 3101 raft_consensus.cc:348] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.487800 3101 raft_consensus.cc:374] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:41.487818 3101 raft_consensus.cc:729] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbca016a0ea4ef2a53e7fddb08a5adc, State: Initialized, Role: FOLLOWER
I20260811 00:50:41.487936 3101 consensus_queue.cc:260] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.488199 2530 heartbeater.cc:503] Master 127.26.99.190:37535 was elected leader, sending a full tablet report...
I20260811 00:50:41.488183 3101 ts_tablet_manager.cc:1428] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260811 00:50:41.558590 2813 tablet.cc:2369] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:41.564247 3105 raft_consensus.cc:482] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:41.564394 3105 raft_consensus.cc:504] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.564755 3105 leader_election.cc:288] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9164366daab48e29c411fea408dfa3b (127.26.99.131:39295), 2fbca016a0ea4ef2a53e7fddb08a5adc (127.26.99.129:32901)
I20260811 00:50:41.567584 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.565103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:48361 (local address 127.26.99.129:32901)
0811 00:50:41.565157 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.565159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.565271 (+ 112us) server_negotiation.cc:407] Connection header received
0811 00:50:41.565301 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.565301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.565311 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.565365 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:41.565519 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.566005 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.566893 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.567249 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.567310 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.567318 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.567484 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.567518 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:50:41.567587 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.564999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:34227 (local address 127.26.99.131:39295)
0811 00:50:41.565049 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.565051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.565084 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:50:41.565114 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.565115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.565124 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.565170 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:41.565354 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.565890 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.566850 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.567245 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.567310 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.567319 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.567487 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.567523 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:50:41.567590 2818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.564932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39295 (local address 127.26.99.130:34227)
0811 00:50:41.564991 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.565000 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.565047 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.565199 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.565200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.565207 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:41.565284 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.565287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.565974 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.565975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.566761 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.566764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.567318 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.567319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.567404 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.567406 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.567469 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.567511 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 00:50:41.567597 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.565030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:32901 (local address 127.26.99.130:48361)
0811 00:50:41.565206 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.565215 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.565264 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.565373 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.565374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.565375 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:41.565455 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.565457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.566075 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.566076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.566803 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:41.566806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.567328 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.567329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:41.567407 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.567410 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.567463 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.567507 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260811 00:50:41.567961 2972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c770fad8ed9945bd802fd8a4aa032a82" candidate_uuid: "08b388bd59604db090e732a7104a7640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9164366daab48e29c411fea408dfa3b" is_pre_election: true
I20260811 00:50:41.568048 2439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c770fad8ed9945bd802fd8a4aa032a82" candidate_uuid: "08b388bd59604db090e732a7104a7640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" is_pre_election: true
I20260811 00:50:41.568122 2972 raft_consensus.cc:2454] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08b388bd59604db090e732a7104a7640 in term 0.
I20260811 00:50:41.568202 2439 raft_consensus.cc:2454] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08b388bd59604db090e732a7104a7640 in term 0.
I20260811 00:50:41.568388 2578 leader_election.cc:302] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b388bd59604db090e732a7104a7640, e9164366daab48e29c411fea408dfa3b; no voters:
I20260811 00:50:41.568547 3105 raft_consensus.cc:2781] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:41.568616 3105 raft_consensus.cc:482] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:41.568646 3105 raft_consensus.cc:3037] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:41.569334 3105 raft_consensus.cc:504] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.569453 3105 leader_election.cc:288] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [CANDIDATE]: Term 1 election: Requested vote from peers e9164366daab48e29c411fea408dfa3b (127.26.99.131:39295), 2fbca016a0ea4ef2a53e7fddb08a5adc (127.26.99.129:32901)
I20260811 00:50:41.569612 2439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c770fad8ed9945bd802fd8a4aa032a82" candidate_uuid: "08b388bd59604db090e732a7104a7640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc"
I20260811 00:50:41.569676 2972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c770fad8ed9945bd802fd8a4aa032a82" candidate_uuid: "08b388bd59604db090e732a7104a7640" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9164366daab48e29c411fea408dfa3b"
I20260811 00:50:41.569715 2439 raft_consensus.cc:3037] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:41.569767 2972 raft_consensus.cc:3037] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:41.570607 2439 raft_consensus.cc:2454] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08b388bd59604db090e732a7104a7640 in term 1.
I20260811 00:50:41.570611 2972 raft_consensus.cc:2454] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08b388bd59604db090e732a7104a7640 in term 1.
I20260811 00:50:41.570822 2581 leader_election.cc:302] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b388bd59604db090e732a7104a7640, 2fbca016a0ea4ef2a53e7fddb08a5adc; no voters:
I20260811 00:50:41.570902 3105 raft_consensus.cc:2781] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:41.571027 3105 raft_consensus.cc:686] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 1 LEADER]: Becoming Leader. State: Replica: 08b388bd59604db090e732a7104a7640, State: Running, Role: LEADER
I20260811 00:50:41.571115 3105 consensus_queue.cc:237] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } }
I20260811 00:50:41.571926 2159 catalog_manager.cc:5495] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08b388bd59604db090e732a7104a7640 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "08b388bd59604db090e732a7104a7640" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b388bd59604db090e732a7104a7640" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 45515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:41.590507 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.588222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42300 (local address 127.26.99.130:45515)
0811 00:50:41.588272 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.588274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.588282 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:41.588359 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.588360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.588381 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.588482 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:41.588628 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.589107 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.589820 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:41.590004 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:41.590056 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:41.590203 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:41.590297 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:41.590364 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.590399 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.590419 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:41.592144 2972 raft_consensus.cc:1261] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 1 FOLLOWER]: Refusing update from remote peer 08b388bd59604db090e732a7104a7640: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:41.592144 2439 raft_consensus.cc:1261] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 1 FOLLOWER]: Refusing update from remote peer 08b388bd59604db090e732a7104a7640: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:41.592475 3112 consensus_queue.cc:1035] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9164366daab48e29c411fea408dfa3b" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:41.592594 3105 consensus_queue.cc:1035] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbca016a0ea4ef2a53e7fddb08a5adc" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:41.595366 3119 mvcc.cc:205] Tried to move back new op lower bound from 7317133072758878208 to 7317133072675872768. Current Snapshot: MvccSnapshot[applied={T|T < 7317133072758878208}]
I20260811 00:50:41.597221 2160 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:41.597301 2160 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:41.598001 2160 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fce988d98eb491999a55eddc51f0df7: Sending DeleteTablet for 3 replicas of tablet c770fad8ed9945bd802fd8a4aa032a82
I20260811 00:50:41.598337 2401 tablet_service.cc:1514] Processing DeleteTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:41 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:43116
I20260811 00:50:41.598361 2678 tablet_service.cc:1514] Processing DeleteTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:41 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:42298
I20260811 00:50:41.598362 2937 tablet_service.cc:1514] Processing DeleteTablet for tablet c770fad8ed9945bd802fd8a4aa032a82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:41 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:50652
I20260811 00:50:41.598589 3134 tablet_replica.cc:330] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: stopping tablet replica
I20260811 00:50:41.598649 3137 tablet_replica.cc:330] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc: stopping tablet replica
I20260811 00:50:41.598752 3137 raft_consensus.cc:2229] T c770fad8ed9945bd802fd8a4aa032a82 P 2fbca016a0ea4ef2a53e7fddb08a5adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:41.598752 3134 raft_consensus.cc:2229] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:41.598762 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2276
I20260811 00:50:41.607973 3134 raft_consensus.cc:2258] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:41.609292 3134 ts_tablet_manager.cc:1905] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:41.611268 3134 ts_tablet_manager.cc:1918] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:41.611338 3134 log.cc:1196] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/c770fad8ed9945bd802fd8a4aa032a82
I20260811 00:50:41.611541 3134 ts_tablet_manager.cc:1939] T c770fad8ed9945bd802fd8a4aa032a82 P e9164366daab48e29c411fea408dfa3b: Deleting consensus metadata
I20260811 00:50:41.612591 2129 catalog_manager.cc:4841] TS e9164366daab48e29c411fea408dfa3b (127.26.99.131:39295): tablet c770fad8ed9945bd802fd8a4aa032a82 (table test-table [id=83ec9f50afcf4e888b104bcd26f830de]) successfully deleted
I20260811 00:50:41.620494 3136 tablet_replica.cc:330] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640: stopping tablet replica
W20260811 00:50:41.620577 2134 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:32901 (error 108)
I20260811 00:50:41.620647 3136 raft_consensus.cc:2229] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:41.620805 3136 raft_consensus.cc:2258] T c770fad8ed9945bd802fd8a4aa032a82 P 08b388bd59604db090e732a7104a7640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:41.621073 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.620937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:32901 (local address 127.0.0.1:43128)
0811 00:50:41.621000 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.621038 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:32901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 00:50:41.621188 2134 catalog_manager.cc:4584] TS 2fbca016a0ea4ef2a53e7fddb08a5adc (127.26.99.129:32901): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c770fad8ed9945bd802fd8a4aa032a82: Network error: Client connection negotiation failed: client connection to 127.26.99.129:32901: connect: Connection refused (error 111)
I20260811 00:50:41.621289 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2542
I20260811 00:50:41.638356 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2827
I20260811 00:50:41.638455 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.638330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:45515 (local address 127.0.0.1:42302)
0811 00:50:41.638385 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.638418 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.130:45515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 00:50:41.647507 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2093
2026-08-11T00:50:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2080 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T00:50:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:41Z Disabled control of system clock
I20260811 00:50:41.684125 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34853
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:34853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:50:41.763859 3150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:41.764039 3150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:41.764060 3150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:41.765139 3150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:41.765174 3150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:41.765185 3150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:41.765196 3150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:41.765213 3150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:41.766479 3150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:34853
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:41.766649 3150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:41.766880 3150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:41.771471 3150 server_base.cc:1034] running on GCE node
W20260811 00:50:41.771427 3162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.771466 3161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.771443 3165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:41.771858 3150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:41.772126 3150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:41.773262 3150 hybrid_clock.cc:648] HybridClock initialized: now 1786409441773247 us; error 29 us; skew 500 ppm
I20260811 00:50:41.774374 3150 webserver.cc:460] Webserver started at http://127.26.99.190:40913/ using document root <none> and password file <none>
I20260811 00:50:41.774593 3150 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:41.774638 3150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:41.774763 3150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:41.775754 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "8912224322444ee6a3a48316d06761aa"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "1c958758deff24cf74d54c71647997e7"
server_key_iv: "fb149ab2667c63bf2214fee3b731b448"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.776108 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "8912224322444ee6a3a48316d06761aa"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "1c958758deff24cf74d54c71647997e7"
server_key_iv: "fb149ab2667c63bf2214fee3b731b448"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.777402 3150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:41.778108 3175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.778234 3150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:41.778312 3150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "8912224322444ee6a3a48316d06761aa"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "1c958758deff24cf74d54c71647997e7"
server_key_iv: "fb149ab2667c63bf2214fee3b731b448"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.778378 3150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:41.781579 3150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:41.781813 3150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:41.781925 3150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:41.785578 3150 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:34853
I20260811 00:50:41.785627 3286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:34853 every 8 connection(s)
I20260811 00:50:41.785907 3150 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:41.786532 3287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:41.788108 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3150
I20260811 00:50:41.788208 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:41.788410 27022 external_mini_cluster.cc:1428] Setting key 36bfad72f4d50ee55eff665b4e53bdcd
I20260811 00:50:41.789750 3287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: Bootstrap starting.
I20260811 00:50:41.790396 3287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:41.790694 3287 log.cc:824] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:41.790838 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.788923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41206 (local address 127.26.99.190:34853)
0811 00:50:41.789094 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.789101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.789127 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:50:41.789539 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.789545 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.789582 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.789698 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.790299 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.790302 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.790302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:41.790306 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.790343 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:41.790352 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.790418 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.790492 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.790647 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260811 00:50:41.791337 3287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: No bootstrap required, opened a new log
I20260811 00:50:41.792737 3287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } }
I20260811 00:50:41.792860 3287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:41.792881 3287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8912224322444ee6a3a48316d06761aa, State: Initialized, Role: FOLLOWER
I20260811 00:50:41.792969 3287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } }
I20260811 00:50:41.793048 3287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:41.793076 3287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:41.793113 3287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:41.793828 3287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } }
I20260811 00:50:41.793919 3287 leader_election.cc:302] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8912224322444ee6a3a48316d06761aa; no voters:
I20260811 00:50:41.794059 3287 leader_election.cc:288] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:41.794096 3293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:41.794224 3293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [term 1 LEADER]: Becoming Leader. State: Replica: 8912224322444ee6a3a48316d06761aa, State: Running, Role: LEADER
I20260811 00:50:41.794315 3287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:41.794342 3293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } }
I20260811 00:50:41.794703 3298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8912224322444ee6a3a48316d06761aa. Latest consensus state: current_term: 1 leader_uuid: "8912224322444ee6a3a48316d06761aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } } }
I20260811 00:50:41.794812 3298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:41.794699 3297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8912224322444ee6a3a48316d06761aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8912224322444ee6a3a48316d06761aa" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34853 } } }
I20260811 00:50:41.794927 3297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:41.795042 3308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:41.795480 3308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:41.796932 3308 catalog_manager.cc:1347] Generated new cluster ID: 752e8cbb34d648739b2cf7f56ca1ad37
I20260811 00:50:41.796976 3308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:41.833909 3308 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:41.834110 3308 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:41.843036 3308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: Generated new TSK 0
I20260811 00:50:41.843226 3308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:50:41.850832 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--builtin_ntp_servers=127.26.99.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:50:41.932407 3322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:41.932598 3322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:41.932619 3322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:41.933799 3322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:41.933840 3322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:41.933863 3322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:41.935207 3322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:41.935436 3322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:41.935710 3322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:41.940560 3334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.940644 3337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:41.940562 3335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:41.940802 3322 server_base.cc:1034] running on GCE node
I20260811 00:50:41.940986 3322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:41.941183 3322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:41.942317 3322 hybrid_clock.cc:648] HybridClock initialized: now 1786409441942304 us; error 29 us; skew 500 ppm
I20260811 00:50:41.943454 3322 webserver.cc:460] Webserver started at http://127.26.99.129:33833/ using document root <none> and password file <none>
I20260811 00:50:41.943672 3322 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:41.943722 3322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:41.943842 3322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:41.944851 3322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "e094e91037d54fdaa4c272398341e993"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "c6224c82f08aca876301def779128d20"
server_key_iv: "385b13d534ac646000345819050f1067"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.945165 3322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "e094e91037d54fdaa4c272398341e993"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "c6224c82f08aca876301def779128d20"
server_key_iv: "385b13d534ac646000345819050f1067"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.946409 3322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:41.947067 3360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.947211 3322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:41.947291 3322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "e094e91037d54fdaa4c272398341e993"
format_stamp: "Formatted at 2026-08-11 00:50:41 on dist-test-slave-xt4k"
server_key: "c6224c82f08aca876301def779128d20"
server_key_iv: "385b13d534ac646000345819050f1067"
server_key_version: "encryptionkey@0"
I20260811 00:50:41.947348 3322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:41.950518 3322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:41.950737 3322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:41.950850 3322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:41.951021 3322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:41.951301 3322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:41.951333 3322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.951359 3322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:41.951382 3322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:41.956642 3322 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36553
I20260811 00:50:41.956705 3584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36553 every 8 connection(s)
I20260811 00:50:41.956967 3322 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:41.959532 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.957644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:41543 (local address 127.26.99.190:34853)
0811 00:50:41.957703 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:41.957705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:41.957894 (+ 189us) server_negotiation.cc:407] Connection header received
0811 00:50:41.958304 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:41.958305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:41.958310 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:41.958358 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:41.959377 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:41.959377 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:41.959378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:41.959380 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:41.959390 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:41.959393 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:41.959427 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:41.959471 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:50:41.959481 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:50:41.959712 3589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:41.957620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34853 (local address 127.26.99.129:41543)
0811 00:50:41.957792 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:41.957823 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:41.958228 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:41.958409 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:41.958412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:41.958420 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:41.959259 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:41.959259 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:41.959287 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:41.959314 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:41.959427 (+ 113us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:41.959430 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:41.959432 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:50:41.959477 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:50:41.959521 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260811 00:50:41.960155 3586 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34853
I20260811 00:50:41.960237 3586 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:41.960402 3586 heartbeater.cc:511] Master 127.26.99.190:34853 requested a full tablet report, sending...
I20260811 00:50:41.960898 3208 ts_manager.cc:194] Registered new tserver with Master: e094e91037d54fdaa4c272398341e993 (127.26.99.129:36553)
I20260811 00:50:41.966269 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3322
I20260811 00:50:41.966353 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:41.966504 27022 external_mini_cluster.cc:1428] Setting key ec0866a8daa0e0ad492bf4dd5338a70a
I20260811 00:50:41.967286 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--builtin_ntp_servers=127.26.99.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:50:42.048556 3590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:42.048748 3590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:42.048768 3590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:42.049945 3590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:42.049984 3590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:42.050009 3590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:42.051383 3590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:42.051601 3590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:42.051875 3590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:42.056612 3601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.056627 3598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.056764 3590 server_base.cc:1034] running on GCE node
W20260811 00:50:42.056607 3597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.057094 3590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:42.057304 3590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:42.058472 3590 hybrid_clock.cc:648] HybridClock initialized: now 1786409442058456 us; error 34 us; skew 500 ppm
I20260811 00:50:42.059679 3590 webserver.cc:460] Webserver started at http://127.26.99.130:39365/ using document root <none> and password file <none>
I20260811 00:50:42.059891 3590 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:42.059937 3590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:42.060066 3590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:42.061148 3590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "cbc6fb74e51347499cfb138b93bb7915"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "dd767b8da6823e8951d209675e199817"
server_key_iv: "dc035128850920bfc0279102b245a71d"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.061553 3590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "cbc6fb74e51347499cfb138b93bb7915"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "dd767b8da6823e8951d209675e199817"
server_key_iv: "dc035128850920bfc0279102b245a71d"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.062855 3590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:50:42.063462 3609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.063594 3590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:42.063673 3590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "cbc6fb74e51347499cfb138b93bb7915"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "dd767b8da6823e8951d209675e199817"
server_key_iv: "dc035128850920bfc0279102b245a71d"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.063736 3590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:42.066852 3590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:42.067068 3590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:42.067175 3590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:42.067345 3590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:42.067617 3590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:42.067652 3590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.067682 3590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:42.067704 3590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.073020 3590 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:38683
I20260811 00:50:42.073078 3819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:38683 every 8 connection(s)
I20260811 00:50:42.073336 3590 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:42.075901 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.074035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:42683 (local address 127.26.99.190:34853)
0811 00:50:42.074089 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.074091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.074273 (+ 182us) server_negotiation.cc:407] Connection header received
0811 00:50:42.074710 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.074711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.074717 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.074761 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.075727 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.075728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.075728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.075732 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.075746 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.075750 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.075788 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.075837 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.075848 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:50:42.076058 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.074017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34853 (local address 127.26.99.130:42683)
0811 00:50:42.074179 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.074209 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.074632 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.074817 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.074820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.074828 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.075607 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.075607 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.075632 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.075657 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.075794 (+ 137us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.075796 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.075798 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.075842 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.075887 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":85,"threads_started":1}
I20260811 00:50:42.076475 3824 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34853
I20260811 00:50:42.076553 3824 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:42.076694 3824 heartbeater.cc:511] Master 127.26.99.190:34853 requested a full tablet report, sending...
I20260811 00:50:42.077001 3208 ts_manager.cc:194] Registered new tserver with Master: cbc6fb74e51347499cfb138b93bb7915 (127.26.99.130:38683)
I20260811 00:50:42.082221 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3590
I20260811 00:50:42.082319 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:42.082494 27022 external_mini_cluster.cc:1428] Setting key f75c51a78ca814a37bf8234d7433b23d
I20260811 00:50:42.083401 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--builtin_ntp_servers=127.26.99.148:36993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 00:50:42.164484 3831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:42.164670 3831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:42.164690 3831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:42.165771 3831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:42.165802 3831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:42.165825 3831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:42.167163 3831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:34853
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:42.167357 3831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:42.167585 3831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:42.172261 3845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.172269 3839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.172266 3841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.172360 3831 server_base.cc:1034] running on GCE node
I20260811 00:50:42.172694 3831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:42.172899 3831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:42.174031 3831 hybrid_clock.cc:648] HybridClock initialized: now 1786409442174018 us; error 31 us; skew 500 ppm
I20260811 00:50:42.175251 3831 webserver.cc:460] Webserver started at http://127.26.99.131:37387/ using document root <none> and password file <none>
I20260811 00:50:42.175454 3831 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:42.175498 3831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:42.175626 3831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:42.176689 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "17698b398fcc4521868121cfa4dc1449"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "139db7823500636d5e3728fd7b264fc0"
server_key_iv: "e474960d124e6cfa978b5da192792650"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.177002 3831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "17698b398fcc4521868121cfa4dc1449"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "139db7823500636d5e3728fd7b264fc0"
server_key_iv: "e474960d124e6cfa978b5da192792650"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.178352 3831 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:42.179009 3854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.179164 3831 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:42.179244 3831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "17698b398fcc4521868121cfa4dc1449"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "139db7823500636d5e3728fd7b264fc0"
server_key_iv: "e474960d124e6cfa978b5da192792650"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.179304 3831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:42.182542 3831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:42.182766 3831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:42.182878 3831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:42.183056 3831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:42.183385 3831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:42.183420 3831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.183446 3831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:42.183463 3831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.188733 3831 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:37519
I20260811 00:50:42.188777 4078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:37519 every 8 connection(s)
I20260811 00:50:42.189054 3831 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:42.191752 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.189683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:46061 (local address 127.26.99.190:34853)
0811 00:50:42.189736 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.189737 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.189932 (+ 195us) server_negotiation.cc:407] Connection header received
0811 00:50:42.190387 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.190388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.190395 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.190447 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.191516 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.191517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.191517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.191522 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.191538 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.191542 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.191590 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.191669 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.191683 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:42.191917 4083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.189663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:34853 (local address 127.26.99.131:46061)
0811 00:50:42.189827 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.189858 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.190292 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.190513 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.190517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.190525 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.191369 (+ 844us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.191370 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.191396 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.191424 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.191594 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.191599 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.191602 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.191674 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.191734 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260811 00:50:42.192392 4079 heartbeater.cc:347] Connected to a master server at 127.26.99.190:34853
I20260811 00:50:42.192467 4079 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:42.192579 4079 heartbeater.cc:511] Master 127.26.99.190:34853 requested a full tablet report, sending...
I20260811 00:50:42.192904 3208 ts_manager.cc:194] Registered new tserver with Master: 17698b398fcc4521868121cfa4dc1449 (127.26.99.131:37519)
I20260811 00:50:42.198390 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3831
I20260811 00:50:42.198477 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:42.198637 27022 external_mini_cluster.cc:1428] Setting key 39b79da81f2a4947741d02d7510c65ea
I20260811 00:50:42.199430 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:42.201493 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.200663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41220 (local address 127.26.99.190:34853)
0811 00:50:42.200724 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.200726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.200814 (+ 88us) server_negotiation.cc:407] Connection header received
0811 00:50:42.200865 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.200866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.200870 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.200904 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.201330 (+ 426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.201331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.201331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.201334 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.201347 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.201350 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.201390 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.201419 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.201429 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:50:42.202823 3208 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:42.204351 3208 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:42.207952 4097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37519 (local address 127.0.0.1:52296)
0811 00:50:42.206742 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.206752 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.206823 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.206979 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.206980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.206983 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.207539 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.207539 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.207556 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.207580 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.207808 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.207814 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.207817 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.207871 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.207884 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":99,"threads_started":1}
I20260811 00:50:42.207975 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52296 (local address 127.26.99.131:37519)
0811 00:50:42.206721 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.206725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.206826 (+ 101us) server_negotiation.cc:407] Connection header received
0811 00:50:42.206884 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.206886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.206896 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.206973 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.207663 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.207671 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.207671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.207675 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.207708 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.207732 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.207785 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.207891 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.207906 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260811 00:50:42.208058 4094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36553 (local address 127.0.0.1:34780)
0811 00:50:42.206912 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.206921 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.206963 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.207372 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.207373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.207376 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.207666 (+ 290us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.207666 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.207673 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.207687 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.207939 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.207940 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.207941 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.207983 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.207996 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260811 00:50:42.208215 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.26.99.129:36553)
0811 00:50:42.206895 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.206899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.207131 (+ 232us) server_negotiation.cc:407] Connection header received
0811 00:50:42.207161 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.207164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.207249 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.207346 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.207779 (+ 433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.207787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.207788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.207792 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.207826 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.207855 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.207911 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.208118 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.208135 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260811 00:50:42.208761 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:38683 (local address 127.0.0.1:41478)
0811 00:50:42.206458 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.206496 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.206549 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.206891 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.206899 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.206905 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.207674 (+ 769us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.207674 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.207680 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.207690 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.208639 (+ 949us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.208640 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.208641 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.208686 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.208700 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":62,"threads_started":1}
I20260811 00:50:42.208786 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.206560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41478 (local address 127.26.99.130:38683)
0811 00:50:42.206729 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.206734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.206745 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:42.206775 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.206777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.206787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.207766 (+ 979us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.208499 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.208507 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.208507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.208511 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.208541 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.208563 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.208621 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.208694 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.208707 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260811 00:50:42.208880 3963 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26204be1a249e5adb6caefa8d46531 (DEFAULT_TABLE table=test-table [id=b9e0c3d94e7b4b32ad075fcb3ced4ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:42.208881 3450 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26204be1a249e5adb6caefa8d46531 (DEFAULT_TABLE table=test-table [id=b9e0c3d94e7b4b32ad075fcb3ced4ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:42.209236 3450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26204be1a249e5adb6caefa8d46531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.209236 3963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26204be1a249e5adb6caefa8d46531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.212437 4110 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Bootstrap starting.
I20260811 00:50:42.212533 4105 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: Bootstrap starting.
I20260811 00:50:42.213030 3701 tablet_service.cc:1467] Processing CreateTablet for tablet 8e26204be1a249e5adb6caefa8d46531 (DEFAULT_TABLE table=test-table [id=b9e0c3d94e7b4b32ad075fcb3ced4ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:42.213266 4105 tablet_bootstrap.cc:654] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.213266 4110 tablet_bootstrap.cc:654] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.213337 3701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e26204be1a249e5adb6caefa8d46531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.213605 4110 log.cc:824] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.213605 4105 log.cc:824] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.214524 4105 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: No bootstrap required, opened a new log
I20260811 00:50:42.214571 4110 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: No bootstrap required, opened a new log
I20260811 00:50:42.214587 4105 ts_tablet_manager.cc:1397] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:42.214694 4110 ts_tablet_manager.cc:1397] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:42.216444 4115 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Bootstrap starting.
I20260811 00:50:42.216444 4105 raft_consensus.cc:348] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.216696 4105 raft_consensus.cc:374] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.216794 4105 raft_consensus.cc:729] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e094e91037d54fdaa4c272398341e993, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.216982 4105 consensus_queue.cc:260] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.217037 4110 raft_consensus.cc:348] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.217163 4110 raft_consensus.cc:374] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.217195 4110 raft_consensus.cc:729] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17698b398fcc4521868121cfa4dc1449, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.217228 4115 tablet_bootstrap.cc:654] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.217360 4105 ts_tablet_manager.cc:1428] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:42.217358 4110 consensus_queue.cc:260] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.217379 3586 heartbeater.cc:503] Master 127.26.99.190:34853 was elected leader, sending a full tablet report...
I20260811 00:50:42.217620 4110 ts_tablet_manager.cc:1428] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:42.217808 4079 heartbeater.cc:503] Master 127.26.99.190:34853 was elected leader, sending a full tablet report...
I20260811 00:50:42.217865 4115 log.cc:824] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.218554 4115 tablet_bootstrap.cc:492] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: No bootstrap required, opened a new log
I20260811 00:50:42.218608 4115 ts_tablet_manager.cc:1397] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:50:42.220288 4115 raft_consensus.cc:348] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.220440 4115 raft_consensus.cc:374] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.220469 4115 raft_consensus.cc:729] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc6fb74e51347499cfb138b93bb7915, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.220544 4115 consensus_queue.cc:260] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.220718 4115 ts_tablet_manager.cc:1428] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:42.220767 3824 heartbeater.cc:503] Master 127.26.99.190:34853 was elected leader, sending a full tablet report...
I20260811 00:50:42.238807 4120 raft_consensus.cc:482] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:42.238902 4120 raft_consensus.cc:504] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.239183 4120 leader_election.cc:288] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17698b398fcc4521868121cfa4dc1449 (127.26.99.131:37519), e094e91037d54fdaa4c272398341e993 (127.26.99.129:36553)
I20260811 00:50:42.240298 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.239334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36553 (local address 127.26.99.130:42809)
0811 00:50:42.239392 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.239403 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.239436 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.239571 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.239573 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.239575 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.240014 (+ 439us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.240015 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.240021 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.240034 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.240175 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.240175 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.240176 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.240223 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.240235 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 00:50:42.240352 4104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.239396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:42809 (local address 127.26.99.129:36553)
0811 00:50:42.239455 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.239457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.239468 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:42.239492 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.239493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.239499 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.239554 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.240099 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.240100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.240101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.240105 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.240119 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.240124 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.240173 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.240247 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.240262 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:50:42.240432 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.239409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:39749 (local address 127.26.99.131:37519)
0811 00:50:42.239462 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.239463 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.239636 (+ 173us) server_negotiation.cc:407] Connection header received
0811 00:50:42.239662 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.239663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.239667 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.239727 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.240217 (+ 490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.240218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.240219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.240223 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.240237 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.240241 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.240288 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.240332 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.240375 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:42.240445 4122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.239334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37519 (local address 127.26.99.130:39749)
0811 00:50:42.239570 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.239578 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.239628 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.239735 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.239736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.239738 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:42.240141 (+ 403us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:50:42.240142 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:42.240149 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:50:42.240162 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:42.240287 (+ 125us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:42.240287 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:42.240288 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:42.240331 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:50:42.240361 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":91,"thread_start_us":92,"threads_started":1}
I20260811 00:50:42.240630 3489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26204be1a249e5adb6caefa8d46531" candidate_uuid: "cbc6fb74e51347499cfb138b93bb7915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e094e91037d54fdaa4c272398341e993" is_pre_election: true
I20260811 00:50:42.240700 3994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26204be1a249e5adb6caefa8d46531" candidate_uuid: "cbc6fb74e51347499cfb138b93bb7915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17698b398fcc4521868121cfa4dc1449" is_pre_election: true
I20260811 00:50:42.240774 3489 raft_consensus.cc:2454] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6fb74e51347499cfb138b93bb7915 in term 0.
I20260811 00:50:42.240809 3994 raft_consensus.cc:2454] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbc6fb74e51347499cfb138b93bb7915 in term 0.
I20260811 00:50:42.241000 3613 leader_election.cc:302] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbc6fb74e51347499cfb138b93bb7915, e094e91037d54fdaa4c272398341e993; no voters:
I20260811 00:50:42.241133 4120 raft_consensus.cc:2781] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:42.241191 4120 raft_consensus.cc:482] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:42.241207 4120 raft_consensus.cc:3037] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.241880 4120 raft_consensus.cc:504] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.241997 4120 leader_election.cc:288] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [CANDIDATE]: Term 1 election: Requested vote from peers 17698b398fcc4521868121cfa4dc1449 (127.26.99.131:37519), e094e91037d54fdaa4c272398341e993 (127.26.99.129:36553)
I20260811 00:50:42.242125 3994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26204be1a249e5adb6caefa8d46531" candidate_uuid: "cbc6fb74e51347499cfb138b93bb7915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17698b398fcc4521868121cfa4dc1449"
I20260811 00:50:42.242184 3489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e26204be1a249e5adb6caefa8d46531" candidate_uuid: "cbc6fb74e51347499cfb138b93bb7915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e094e91037d54fdaa4c272398341e993"
I20260811 00:50:42.242204 3994 raft_consensus.cc:3037] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.242250 3489 raft_consensus.cc:3037] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.243055 3994 raft_consensus.cc:2454] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6fb74e51347499cfb138b93bb7915 in term 1.
I20260811 00:50:42.243055 3489 raft_consensus.cc:2454] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbc6fb74e51347499cfb138b93bb7915 in term 1.
I20260811 00:50:42.243220 3615 leader_election.cc:302] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17698b398fcc4521868121cfa4dc1449, cbc6fb74e51347499cfb138b93bb7915; no voters:
I20260811 00:50:42.243317 4120 raft_consensus.cc:2781] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:42.243462 4120 raft_consensus.cc:686] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 1 LEADER]: Becoming Leader. State: Replica: cbc6fb74e51347499cfb138b93bb7915, State: Running, Role: LEADER
I20260811 00:50:42.243551 4120 consensus_queue.cc:237] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } }
I20260811 00:50:42.244285 3208 catalog_manager.cc:5495] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbc6fb74e51347499cfb138b93bb7915 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "cbc6fb74e51347499cfb138b93bb7915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbc6fb74e51347499cfb138b93bb7915" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:42.252894 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.252006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41480 (local address 127.26.99.130:38683)
0811 00:50:42.252056 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.252057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.252064 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:42.252131 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.252132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.252144 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.252184 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.252693 (+ 509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.252693 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.252694 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.252698 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.252713 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.252717 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.252765 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.252823 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.252835 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:50:42.254415 3994 raft_consensus.cc:1261] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 1 FOLLOWER]: Refusing update from remote peer cbc6fb74e51347499cfb138b93bb7915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:42.254415 3489 raft_consensus.cc:1261] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 1 FOLLOWER]: Refusing update from remote peer cbc6fb74e51347499cfb138b93bb7915: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:42.254736 4123 consensus_queue.cc:1035] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17698b398fcc4521868121cfa4dc1449" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:42.254845 4120 consensus_queue.cc:1035] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e094e91037d54fdaa4c272398341e993" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:42.257175 4127 mvcc.cc:205] Tried to move back new op lower bound from 7317133075471982592 to 7317133075430199296. Current Snapshot: MvccSnapshot[applied={T|T < 7317133075471982592}]
I20260811 00:50:42.258957 3208 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:42.259042 3208 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:42.259728 3208 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8912224322444ee6a3a48316d06761aa: Sending DeleteTablet for 3 replicas of tablet 8e26204be1a249e5adb6caefa8d46531
I20260811 00:50:42.260015 3963 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26204be1a249e5adb6caefa8d46531 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:42 UTC) from {username='slave'} at 127.0.0.1:52296
I20260811 00:50:42.260047 3701 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26204be1a249e5adb6caefa8d46531 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:42 UTC) from {username='slave'} at 127.0.0.1:41478
I20260811 00:50:42.260164 3450 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e26204be1a249e5adb6caefa8d46531 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:42 UTC) from {username='slave'} at 127.0.0.1:34780
I20260811 00:50:42.260425 4153 tablet_replica.cc:330] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993: stopping tablet replica
I20260811 00:50:42.260440 4150 tablet_replica.cc:330] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: stopping tablet replica
I20260811 00:50:42.260524 4150 raft_consensus.cc:2229] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:42.260615 4153 raft_consensus.cc:2229] T 8e26204be1a249e5adb6caefa8d46531 P e094e91037d54fdaa4c272398341e993 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:42.260635 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3322
I20260811 00:50:42.260653 4150 raft_consensus.cc:2258] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:42.261024 4150 ts_tablet_manager.cc:1905] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:42.262734 4150 ts_tablet_manager.cc:1918] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:42.262805 4150 log.cc:1196] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/8e26204be1a249e5adb6caefa8d46531
I20260811 00:50:42.263079 4150 ts_tablet_manager.cc:1939] T 8e26204be1a249e5adb6caefa8d46531 P 17698b398fcc4521868121cfa4dc1449: Deleting consensus metadata
I20260811 00:50:42.263512 3183 catalog_manager.cc:4841] TS 17698b398fcc4521868121cfa4dc1449 (127.26.99.131:37519): tablet 8e26204be1a249e5adb6caefa8d46531 (table test-table [id=b9e0c3d94e7b4b32ad075fcb3ced4ff4]) successfully deleted
I20260811 00:50:42.263726 4152 tablet_replica.cc:330] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: stopping tablet replica
I20260811 00:50:42.263825 4152 raft_consensus.cc:2229] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:42.263916 4152 raft_consensus.cc:2258] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:42.266299 4152 ts_tablet_manager.cc:1905] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:42.267467 4152 ts_tablet_manager.cc:1918] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:42.267514 4152 log.cc:1196] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/8e26204be1a249e5adb6caefa8d46531
I20260811 00:50:42.267695 4152 ts_tablet_manager.cc:1939] T 8e26204be1a249e5adb6caefa8d46531 P cbc6fb74e51347499cfb138b93bb7915: Deleting consensus metadata
I20260811 00:50:42.272675 3180 catalog_manager.cc:4841] TS cbc6fb74e51347499cfb138b93bb7915 (127.26.99.130:38683): tablet 8e26204be1a249e5adb6caefa8d46531 (table test-table [id=b9e0c3d94e7b4b32ad075fcb3ced4ff4]) successfully deleted
W20260811 00:50:42.278654 3178 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:36553 (error 108)
I20260811 00:50:42.279147 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.279011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36553 (local address 127.0.0.1:34782)
0811 00:50:42.279064 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.279109 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 00:50:42.279227 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3590
W20260811 00:50:42.288731 3178 catalog_manager.cc:4584] TS e094e91037d54fdaa4c272398341e993 (127.26.99.129:36553): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8e26204be1a249e5adb6caefa8d46531: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36553: connect: Connection refused (error 111)
I20260811 00:50:42.294176 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3831
I20260811 00:50:42.306048 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3150
2026-08-11T00:50:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (657 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 00:50:42.334887 27022 mini_oidc.cc:152] Starting JWKS server
I20260811 00:50:42.336184 27022 webserver.cc:460] Webserver started at https://127.0.0.1:43605/ using document root <none> and password file <none>
I20260811 00:50:42.336275 27022 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:50:42.336465 27022 webserver.cc:460] Webserver started at http://127.0.0.1:44705/ using document root <none> and password file <none>
2026-08-11T00:50:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:42Z Disabled control of system clock
I20260811 00:50:42.345111 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35835
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:35835
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43605/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/testchainca.cert with env {}
W20260811 00:50:42.426137 4164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:42.426327 4164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:42.426347 4164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:42.427445 4164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:42.427479 4164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:42.427489 4164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:42.427500 4164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:42.427515 4164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:50:42.427525 4164 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:50:42.427541 4164 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43605/jwks.json
I20260811 00:50:42.429068 4164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:35835
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43605/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:42.429262 4164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:42.429426 4164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:42.433969 4178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.433946 4172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.433981 4164 server_base.cc:1034] running on GCE node
W20260811 00:50:42.433964 4171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.434458 4164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:42.434719 4164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:42.435876 4164 hybrid_clock.cc:648] HybridClock initialized: now 1786409442435864 us; error 27 us; skew 500 ppm
I20260811 00:50:42.437073 4164 webserver.cc:460] Webserver started at http://127.26.99.190:35659/ using document root <none> and password file <none>
I20260811 00:50:42.437299 4164 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:42.437350 4164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:42.437469 4164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:42.438519 4164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "2f92ac25f182445cbd1d19fa42664fe1"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "9d37962670ec5c6e3df463b29f90a7e6"
server_key_iv: "1bdac0cf71d0910ce5272ccfd0108f40"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.438884 4164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "2f92ac25f182445cbd1d19fa42664fe1"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "9d37962670ec5c6e3df463b29f90a7e6"
server_key_iv: "1bdac0cf71d0910ce5272ccfd0108f40"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.440176 4164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:42.440888 4190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.441033 4164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.441133 4164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "2f92ac25f182445cbd1d19fa42664fe1"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "9d37962670ec5c6e3df463b29f90a7e6"
server_key_iv: "1bdac0cf71d0910ce5272ccfd0108f40"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.441195 4164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:42.452943 4164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:42.453223 4164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:42.453342 4164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:42.456964 4164 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:35835
I20260811 00:50:42.457005 4275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:35835 every 8 connection(s)
I20260811 00:50:42.457309 4164 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:42.458369 4278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.459159 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4164
I20260811 00:50:42.459239 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:42.459417 27022 external_mini_cluster.cc:1428] Setting key b71dbc0c5ac6764417de4998b5ba8dcc
I20260811 00:50:42.460821 4278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1: Bootstrap starting.
I20260811 00:50:42.461445 4278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.461709 4278 log.cc:824] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.462319 4278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1: No bootstrap required, opened a new log
I20260811 00:50:42.464026 4278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } }
I20260811 00:50:42.464165 4278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.464200 4278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f92ac25f182445cbd1d19fa42664fe1, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.464362 4278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } }
I20260811 00:50:42.464443 4278 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:42.464474 4278 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:42.464520 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.459863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34948 (local address 127.26.99.190:35835)
0811 00:50:42.460050 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.460057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.460079 (+ 22us) server_negotiation.cc:407] Connection header received
0811 00:50:42.460652 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.460659 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.460719 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.460841 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.461046 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.461944 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.462759 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.463163 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.463279 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.463891 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.463895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.463895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.464049 (+ 154us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.464080 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.464098 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.464150 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.464222 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.464300 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260811 00:50:42.464521 4278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.465148 4278 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } }
I20260811 00:50:42.465257 4278 leader_election.cc:302] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f92ac25f182445cbd1d19fa42664fe1; no voters:
I20260811 00:50:42.465368 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:50:42.465410 4278 leader_election.cc:288] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:42.465441 4286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:42.465584 4286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [term 1 LEADER]: Becoming Leader. State: Replica: 2f92ac25f182445cbd1d19fa42664fe1, State: Running, Role: LEADER
I20260811 00:50:42.465721 4278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:42.465728 4286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } }
I20260811 00:50:42.466400 4289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f92ac25f182445cbd1d19fa42664fe1. Latest consensus state: current_term: 1 leader_uuid: "2f92ac25f182445cbd1d19fa42664fe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } } }
I20260811 00:50:42.466741 4289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.466135 4288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f92ac25f182445cbd1d19fa42664fe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f92ac25f182445cbd1d19fa42664fe1" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35835 } } }
I20260811 00:50:42.466960 4307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:42.467015 4288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.467502 4307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:42.468921 4307 catalog_manager.cc:1347] Generated new cluster ID: e49968a37589423691e02f42b3538121
I20260811 00:50:42.468974 4307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:42.482230 4307 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:42.482745 4307 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:42.491945 4307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f92ac25f182445cbd1d19fa42664fe1: Generated new TSK 0
I20260811 00:50:42.492136 4307 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 00:50:42.527825 4328 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
I20260811 00:50:42.528034 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.504970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34964 (local address 127.26.99.190:35835)
0811 00:50:42.505021 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.505023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.505208 (+ 185us) server_negotiation.cc:407] Connection header received
0811 00:50:42.505304 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.505305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.505316 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.505371 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:50:42.505539 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.506013 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.507129 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.507314 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.507360 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.507618 (+ 258us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:50:42.527798 (+ 20180us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 00:50:42.527963 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34964: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":27}
E20260811 00:50:42.528079 4328 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 00:50:42.528369 4281 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34964: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 00:50:42.528609 4326 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:42.504916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35835 (local address 127.0.0.1:34964)
0811 00:50:42.505135 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.505145 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.505215 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.505393 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.505393 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.505400 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:50:42.505478 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.505480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.506102 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.506103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:42.507041 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.507044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.507402 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.507402 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:42.507473 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.507499 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:50:42.527940 (+ 20441us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 00:50:42.528061 (+ 121us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.99.190:35835: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.99.190:35835: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43605/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 00:50:42.529065 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4164
2026-08-11T00:50:42Z chronyd exiting
I20260811 00:50:42.587483 27022 test_util.cc:175] -----------------------------------------------
I20260811 00:50:42.587563 27022 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786409417711920-27022-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (253 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 00:50:42.588416 27022 mini_oidc.cc:152] Starting JWKS server
I20260811 00:50:42.589074 27022 webserver.cc:460] Webserver started at https://127.0.0.1:33715/ using document root <none> and password file <none>
I20260811 00:50:42.589118 27022 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:50:42.589251 27022 webserver.cc:460] Webserver started at http://127.0.0.1:37335/ using document root <none> and password file <none>
2026-08-11T00:50:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:42Z Disabled control of system clock
I20260811 00:50:42.597699 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44295
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:45241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:44295
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33715/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/testchainca.cert with env {}
W20260811 00:50:42.677873 4337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:42.678077 4337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:42.678107 4337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:42.679258 4337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:42.679299 4337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:42.679315 4337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:42.679332 4337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:42.679347 4337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:50:42.679369 4337 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:50:42.679392 4337 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33715/jwks.json
I20260811 00:50:42.680925 4337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:45241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:44295
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33715/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:42.681172 4337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:42.681372 4337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:42.685950 4344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.685901 4346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.685901 4343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.686160 4337 server_base.cc:1034] running on GCE node
I20260811 00:50:42.686379 4337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:42.686658 4337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:42.687808 4337 hybrid_clock.cc:648] HybridClock initialized: now 1786409442687795 us; error 30 us; skew 500 ppm
I20260811 00:50:42.689047 4337 webserver.cc:460] Webserver started at http://127.26.99.190:45529/ using document root <none> and password file <none>
I20260811 00:50:42.689262 4337 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:42.689307 4337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:42.689430 4337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:42.690524 4337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "ca20dda37ac34b30882e136665c978c4"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "0fe13b082af343f194f9cc37cff6d14c"
server_key_iv: "29e1d25768ef202ee548695e3b9d6bfc"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.690907 4337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "ca20dda37ac34b30882e136665c978c4"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "0fe13b082af343f194f9cc37cff6d14c"
server_key_iv: "29e1d25768ef202ee548695e3b9d6bfc"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.692204 4337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:42.692907 4359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.693058 4337 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.693148 4337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "ca20dda37ac34b30882e136665c978c4"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "0fe13b082af343f194f9cc37cff6d14c"
server_key_iv: "29e1d25768ef202ee548695e3b9d6bfc"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.693218 4337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:42.710219 4337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:42.710516 4337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:42.710651 4337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:42.714440 4337 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:44295
I20260811 00:50:42.714514 4450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:44295 every 8 connection(s)
I20260811 00:50:42.714787 4337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:42.715422 4451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.718111 4451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4: Bootstrap starting.
I20260811 00:50:42.718734 4451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.718968 4451 log.cc:824] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.719571 4451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4: No bootstrap required, opened a new log
I20260811 00:50:42.721168 4451 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } }
I20260811 00:50:42.721303 4451 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.721324 4451 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca20dda37ac34b30882e136665c978c4, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.721434 4451 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } }
I20260811 00:50:42.721510 4451 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:42.721539 4451 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:42.721571 4451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.721823 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4337
I20260811 00:50:42.721926 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:42.722110 27022 external_mini_cluster.cc:1428] Setting key 25cb112200d969dbbed3e61de5dcfb66
I20260811 00:50:42.722236 4451 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } }
I20260811 00:50:42.722342 4451 leader_election.cc:302] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca20dda37ac34b30882e136665c978c4; no voters:
I20260811 00:50:42.722523 4451 leader_election.cc:288] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:42.722852 4451 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:42.722544 4455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:42.723012 4455 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [term 1 LEADER]: Becoming Leader. State: Replica: ca20dda37ac34b30882e136665c978c4, State: Running, Role: LEADER
I20260811 00:50:42.723173 4455 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } }
I20260811 00:50:42.723753 4460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca20dda37ac34b30882e136665c978c4. Latest consensus state: current_term: 1 leader_uuid: "ca20dda37ac34b30882e136665c978c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } } }
I20260811 00:50:42.723855 4460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.724109 4470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:42.724429 4459 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca20dda37ac34b30882e136665c978c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca20dda37ac34b30882e136665c978c4" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44295 } } }
I20260811 00:50:42.724588 4459 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.724682 4470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:42.725898 4486 mvcc.cc:205] Tried to move back new op lower bound from 7317133077403852800 to 7317133077394604032. Current Snapshot: MvccSnapshot[applied={T|T < 7317133077403852800}]
I20260811 00:50:42.726361 4470 catalog_manager.cc:1347] Generated new cluster ID: ec68caa3db9f49d291fdbb82979fa90b
I20260811 00:50:42.726411 4470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:42.728276 4458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.722584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45806 (local address 127.26.99.190:44295)
0811 00:50:42.722763 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.722772 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.722797 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:50:42.722910 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.722917 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.722985 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.723156 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.723345 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.725093 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.726203 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.726802 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.726937 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.727574 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.727578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.727579 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.727793 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.727839 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.727854 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.727925 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.727980 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.728061 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260811 00:50:42.732807 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:50:42.734906 4470 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:42.735567 4470 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:42.746147 4470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca20dda37ac34b30882e136665c978c4: Generated new TSK 0
I20260811 00:50:42.746336 4470 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 00:50:42.769722 4507 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 00:50:42.769799 4507 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 00:50:42.770149 4458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.754848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45812 (local address 127.26.99.190:44295)
0811 00:50:42.754890 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.754892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.754990 (+ 98us) server_negotiation.cc:407] Connection header received
0811 00:50:42.755047 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.755048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.755059 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.755138 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:50:42.755240 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.756016 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.756792 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.757155 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.757222 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.757343 (+ 121us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:50:42.769908 (+ 12565us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33715/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 00:50:42.770076 (+ 168us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45812: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33715/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 00:50:42.770195 4505 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:42.754780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:44295 (local address 127.0.0.1:45812)
0811 00:50:42.754929 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.754938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.754996 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.755142 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.755143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.755144 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:50:42.755199 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.755201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.756085 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.756086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:42.756723 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.756725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.757218 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.757219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:42.757260 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.757264 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:50:42.770017 (+ 12753us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33715/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 00:50:42.770117 (+ 100us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.99.190:44295: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33715/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
W20260811 00:50:42.770213 4458 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45812: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33715/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260811 00:50:42.770613 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4337
2026-08-11T00:50:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (238 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 00:50:42.827003 27022 mini_oidc.cc:152] Starting JWKS server
I20260811 00:50:42.827687 27022 webserver.cc:460] Webserver started at https://127.0.0.1:37367/ using document root <none> and password file <none>
I20260811 00:50:42.827729 27022 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 00:50:42.827864 27022 webserver.cc:460] Webserver started at http://127.0.0.1:40107/ using document root <none> and password file <none>
2026-08-11T00:50:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:42Z Disabled control of system clock
I20260811 00:50:42.836225 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37591
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:37117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37591
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37367/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 00:50:42.916178 4517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:42.916404 4517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:42.916435 4517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:42.917577 4517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:42.917624 4517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:42.917644 4517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:42.917659 4517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:42.917676 4517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:50:42.917696 4517 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:50:42.917716 4517 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37367/jwks.json
I20260811 00:50:42.919059 4517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37591
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37367/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:42.919308 4517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:42.919575 4517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:42.923974 4527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.924023 4524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:42.923990 4539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:42.924168 4517 server_base.cc:1034] running on GCE node
I20260811 00:50:42.924451 4517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:42.924713 4517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:42.925848 4517 hybrid_clock.cc:648] HybridClock initialized: now 1786409442925837 us; error 28 us; skew 500 ppm
I20260811 00:50:42.926957 4517 webserver.cc:460] Webserver started at http://127.26.99.190:37905/ using document root <none> and password file <none>
I20260811 00:50:42.927198 4517 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:42.927244 4517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:42.927393 4517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:42.928525 4517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "4f23f040f4fb4527aecd845940c6e728"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "1c91d710aaccd9c4ad14caa6b1184cbd"
server_key_iv: "16ecaaa3226dddc47484974dec516068"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.928901 4517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "4f23f040f4fb4527aecd845940c6e728"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "1c91d710aaccd9c4ad14caa6b1184cbd"
server_key_iv: "16ecaaa3226dddc47484974dec516068"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.930142 4517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:42.930838 4551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:42.930974 4517 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:42.931059 4517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "4f23f040f4fb4527aecd845940c6e728"
format_stamp: "Formatted at 2026-08-11 00:50:42 on dist-test-slave-xt4k"
server_key: "1c91d710aaccd9c4ad14caa6b1184cbd"
server_key_iv: "16ecaaa3226dddc47484974dec516068"
server_key_version: "encryptionkey@0"
I20260811 00:50:42.931123 4517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:42.948297 4517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:42.948601 4517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:42.948731 4517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:42.952361 4517 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37591
I20260811 00:50:42.952400 4650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37591 every 8 connection(s)
I20260811 00:50:42.952711 4517 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:42.953318 4652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:42.955902 4652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728: Bootstrap starting.
I20260811 00:50:42.956470 4652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:42.956728 4652 log.cc:824] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:42.957346 4652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728: No bootstrap required, opened a new log
I20260811 00:50:42.958858 4652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } }
I20260811 00:50:42.958989 4652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:42.959021 4652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f23f040f4fb4527aecd845940c6e728, State: Initialized, Role: FOLLOWER
I20260811 00:50:42.959165 4652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } }
I20260811 00:50:42.959242 4652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:42.959276 4652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:42.959324 4652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:42.959832 4652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } }
I20260811 00:50:42.959923 4652 leader_election.cc:302] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f23f040f4fb4527aecd845940c6e728; no voters:
I20260811 00:50:42.960086 4652 leader_election.cc:288] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:42.960125 4659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:42.960207 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4517
I20260811 00:50:42.960278 4659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [term 1 LEADER]: Becoming Leader. State: Replica: 4f23f040f4fb4527aecd845940c6e728, State: Running, Role: LEADER
I20260811 00:50:42.960314 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:42.960361 4652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:42.960383 4659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } }
I20260811 00:50:42.960511 27022 external_mini_cluster.cc:1428] Setting key 36bbfd3a80e6f3ee873ee08c9b326697
I20260811 00:50:42.960680 4659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f23f040f4fb4527aecd845940c6e728. Latest consensus state: current_term: 1 leader_uuid: "4f23f040f4fb4527aecd845940c6e728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } } }
I20260811 00:50:42.961073 4659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.960820 4661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f23f040f4fb4527aecd845940c6e728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f23f040f4fb4527aecd845940c6e728" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37591 } } }
I20260811 00:50:42.961299 4661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:42.961570 4683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:42.962082 4683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:42.963692 4683 catalog_manager.cc:1347] Generated new cluster ID: 3b06d8c14929473db58f4986bd392413
I20260811 00:50:42.963750 4683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:42.966833 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.960911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42132 (local address 127.26.99.190:37591)
0811 00:50:42.961114 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.961123 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.961418 (+ 295us) server_negotiation.cc:407] Connection header received
0811 00:50:42.961629 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.961638 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.961709 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.961823 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:42.962251 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.963579 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.964692 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.965329 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.965471 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:42.966119 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:42.966123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:42.966123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:42.966352 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:42.966394 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:42.966410 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:42.966480 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:42.966536 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 00:50:42.966625 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
I20260811 00:50:42.967691 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:50:42.978534 4683 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:42.979209 4683 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:42.986882 4683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f23f040f4fb4527aecd845940c6e728: Generated new TSK 0
I20260811 00:50:42.987071 4683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:50:43.001255 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:42.997721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.26.99.190:37591)
0811 00:50:42.997767 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:42.997768 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:42.997834 (+ 66us) server_negotiation.cc:407] Connection header received
0811 00:50:42.997918 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:42.997919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:42.997929 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:42.997979 (+ 50us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:50:42.998110 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.998623 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.999734 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.999927 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.999970 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:43.000150 (+ 180us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:50:43.001037 (+ 887us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37367/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 00:50:43.001184 (+ 147us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42142: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37367/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 00:50:43.001314 4675 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42142: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37367/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 00:50:43.001335 4706 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:42.997604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37591 (local address 127.0.0.1:42142)
0811 00:50:42.997765 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:42.997776 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:42.997842 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:42.997990 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:42.997991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:42.997993 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:50:42.998055 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.998057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.998691 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.998692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:42.999664 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:42.999666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:42.999992 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:42.999993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:43.000054 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:43.000060 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:50:43.001132 (+ 1072us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37367/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 00:50:43.001229 (+ 97us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.99.190:37591: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37367/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260811 00:50:43.001556 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4517
E20260811 00:50:43.024295 4709 webserver.cc:533] Webserver: sslize failed:
E20260811 00:50:43.024432 4709 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T00:50:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T00:50:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:43Z Disabled control of system clock
I20260811 00:50:43.062975 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37255
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:37731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37255
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/testchainca.cert with env {}
W20260811 00:50:43.144312 4717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:43.144558 4717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:43.144588 4717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:43.145772 4717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:43.145814 4717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:43.145830 4717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:43.145846 4717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:43.145862 4717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 00:50:43.145885 4717 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 00:50:43.145901 4717 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 00:50:43.147413 4717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:43.147657 4717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:43.147848 4717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:43.152652 4717 server_base.cc:1034] running on GCE node
W20260811 00:50:43.152607 4724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:43.152694 4726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:43.152611 4728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:43.152976 4717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:43.153267 4717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:43.154421 4717 hybrid_clock.cc:648] HybridClock initialized: now 1786409443154401 us; error 34 us; skew 500 ppm
I20260811 00:50:43.155608 4717 webserver.cc:460] Webserver started at http://127.26.99.190:38043/ using document root <none> and password file <none>
I20260811 00:50:43.155821 4717 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:43.155869 4717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:43.155998 4717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:43.157070 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "2852d7c38b3549feb7e63ae899d0ac29"
format_stamp: "Formatted at 2026-08-11 00:50:43 on dist-test-slave-xt4k"
server_key: "6a00448ce5dd2dc28560bb8bb54547a5"
server_key_iv: "c5790df4beaaa3b2dc3274f29f1f42d4"
server_key_version: "encryptionkey@0"
I20260811 00:50:43.157449 4717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "2852d7c38b3549feb7e63ae899d0ac29"
format_stamp: "Formatted at 2026-08-11 00:50:43 on dist-test-slave-xt4k"
server_key: "6a00448ce5dd2dc28560bb8bb54547a5"
server_key_iv: "c5790df4beaaa3b2dc3274f29f1f42d4"
server_key_version: "encryptionkey@0"
I20260811 00:50:43.158871 4717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:43.159602 4741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:43.159772 4717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:43.159859 4717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "2852d7c38b3549feb7e63ae899d0ac29"
format_stamp: "Formatted at 2026-08-11 00:50:43 on dist-test-slave-xt4k"
server_key: "6a00448ce5dd2dc28560bb8bb54547a5"
server_key_iv: "c5790df4beaaa3b2dc3274f29f1f42d4"
server_key_version: "encryptionkey@0"
I20260811 00:50:43.159921 4717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:43.170073 4717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:43.170370 4717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:43.170496 4717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:43.174243 4717 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37255
I20260811 00:50:43.174278 4832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37255 every 8 connection(s)
I20260811 00:50:43.174589 4717 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:43.175529 4834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:43.177173 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4717
I20260811 00:50:43.177289 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:43.177484 27022 external_mini_cluster.cc:1428] Setting key 402a6ea6cff707e8af4a91a19f6f6d8f
I20260811 00:50:43.178171 4834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: Bootstrap starting.
I20260811 00:50:43.178813 4834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:43.179140 4834 log.cc:824] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:43.179797 4834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: No bootstrap required, opened a new log
I20260811 00:50:43.181974 4834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } }
I20260811 00:50:43.182125 4834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:43.182149 4834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2852d7c38b3549feb7e63ae899d0ac29, State: Initialized, Role: FOLLOWER
I20260811 00:50:43.182266 4834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } }
I20260811 00:50:43.182363 4834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:43.182435 4834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:43.182487 4834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:43.183064 4834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } }
I20260811 00:50:43.183123 4843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:43.177984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.26.99.190:37255)
0811 00:50:43.178165 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:43.178172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:43.178197 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:50:43.178654 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:43.178660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:43.178719 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:43.178831 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:43.179073 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.180125 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.181215 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.181651 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.181746 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:43.182475 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:43.182480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:43.182480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:50:43.182669 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:43.182702 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:50:43.182713 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:43.182764 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:43.182861 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 00:50:43.182936 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260811 00:50:43.183167 4834 leader_election.cc:302] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2852d7c38b3549feb7e63ae899d0ac29; no voters:
I20260811 00:50:43.183327 4834 leader_election.cc:288] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:43.183432 4845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:43.183586 4834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:43.183597 4845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [term 1 LEADER]: Becoming Leader. State: Replica: 2852d7c38b3549feb7e63ae899d0ac29, State: Running, Role: LEADER
I20260811 00:50:43.183776 4845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } }
I20260811 00:50:43.183943 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:50:43.184132 4848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2852d7c38b3549feb7e63ae899d0ac29. Latest consensus state: current_term: 1 leader_uuid: "2852d7c38b3549feb7e63ae899d0ac29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } } }
I20260811 00:50:43.184217 4848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:43.184401 4847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2852d7c38b3549feb7e63ae899d0ac29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2852d7c38b3549feb7e63ae899d0ac29" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37255 } } }
I20260811 00:50:43.184461 4847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29 [sys.catalog]: This master's current role is: LEADER
W20260811 00:50:43.185338 4870 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:43.185384 4870 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:43.185446 4859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:43.185617 4859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:43.187052 4859 catalog_manager.cc:1347] Generated new cluster ID: 5ccf586a85ac40da82fccfe02f85067f
I20260811 00:50:43.187108 4859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:43.196951 4859 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:43.197634 4859 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:43.211196 4859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2852d7c38b3549feb7e63ae899d0ac29: Generated new TSK 0
I20260811 00:50:43.211411 4859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:50:43.275159 4843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:43.218219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37346 (local address 127.26.99.190:37255)
0811 00:50:43.218273 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:43.218275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:43.218363 (+ 88us) server_negotiation.cc:407] Connection header received
0811 00:50:43.218443 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:43.218444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:43.218461 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:43.218525 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0811 00:50:43.218656 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.219164 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.219927 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.220115 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.220170 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:43.220355 (+ 185us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 00:50:43.274840 (+ 54485us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 00:50:43.275070 (+ 230us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37346: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 00:50:43.275238 4891 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:43.218148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37255 (local address 127.0.0.1:37346)
0811 00:50:43.218305 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:43.218314 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:43.218372 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:43.218530 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:43.218531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:43.218533 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 00:50:43.218599 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:43.218601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.219237 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.219238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:43.219847 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:43.219849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:43.220187 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:43.220187 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:43.220248 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:43.220254 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 00:50:43.275019 (+ 54765us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 00:50:43.275145 (+ 126us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.99.190:37255: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
W20260811 00:50:43.275244 4843 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37346: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260811 00:50:43.275653 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4717
2026-08-11T00:50:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (252 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (90 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:43 dist-test-slave-xt4k krb5kdc[4917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:43 dist-test-slave-xt4k krb5kdc[4917](info): set up 2 sockets
Aug 11 00:50:43 dist-test-slave-xt4k krb5kdc[4917](info): commencing operation
krb5kdc: starting...
W20260811 00:50:44.645051 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:44 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:44.768623 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38603
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:38603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:44.855458 4935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:44.855681 4935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:44.855783 4935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:44.857081 4935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:44.857124 4935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:44.857138 4935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:44.857149 4935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:44.857160 4935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:44.858668 4935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:38603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:44.858906 4935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:44.859124 4935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:44.863827 4945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:44.863837 4940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:44.863893 4941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:44.863952 4935 server_base.cc:1034] running on GCE node
I20260811 00:50:44.864276 4935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:44.864576 4935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:44.865726 4935 hybrid_clock.cc:648] HybridClock initialized: now 1786409444865711 us; error 28 us; skew 500 ppm
Aug 11 00:50:44 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409444, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:44.871076 4935 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:44.871490 4935 webserver.cc:460] Webserver started at http://127.26.99.190:33305/ using document root <none> and password file <none>
I20260811 00:50:44.871695 4935 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:44.871737 4935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:44.871826 4935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:44.872970 4935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "70f78affb1df4e91877e30539065b29c"
format_stamp: "Formatted at 2026-08-11 00:50:44 on dist-test-slave-xt4k"
server_key: "4e443a32049d369cb5d0643673283974"
server_key_iv: "ce8339dcce6cdf1a8445b1b1b82e1f1e"
server_key_version: "encryptionkey@0"
I20260811 00:50:44.873266 4935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "70f78affb1df4e91877e30539065b29c"
format_stamp: "Formatted at 2026-08-11 00:50:44 on dist-test-slave-xt4k"
server_key: "4e443a32049d369cb5d0643673283974"
server_key_iv: "ce8339dcce6cdf1a8445b1b1b82e1f1e"
server_key_version: "encryptionkey@0"
I20260811 00:50:44.874588 4935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:44.875339 4955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:44.875535 4935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:44.875609 4935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "70f78affb1df4e91877e30539065b29c"
format_stamp: "Formatted at 2026-08-11 00:50:44 on dist-test-slave-xt4k"
server_key: "4e443a32049d369cb5d0643673283974"
server_key_iv: "ce8339dcce6cdf1a8445b1b1b82e1f1e"
server_key_version: "encryptionkey@0"
I20260811 00:50:44.875680 4935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:44.886101 4935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:44.888015 4935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:44.888149 4935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:44.891990 4935 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:38603
I20260811 00:50:44.892033 5043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:38603 every 8 connection(s)
I20260811 00:50:44.892385 4935 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:44.893260 5044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:44.893643 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4935
I20260811 00:50:44.893740 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:44.893926 27022 external_mini_cluster.cc:1428] Setting key 646e10182eb71cb69ffa4e1c5902135e
I20260811 00:50:44.895965 5044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c: Bootstrap starting.
I20260811 00:50:44.896611 5044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:44.896858 5044 log.cc:824] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:44.897609 5044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c: No bootstrap required, opened a new log
I20260811 00:50:44.899932 5044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } }
I20260811 00:50:44.900079 5044 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:44.900102 5044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f78affb1df4e91877e30539065b29c, State: Initialized, Role: FOLLOWER
I20260811 00:50:44.900208 5044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } }
I20260811 00:50:44.900274 5044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:44.900295 5044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:44.900360 5044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 0 FOLLOWER]: Advancing to term 1
Aug 11 00:50:44 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:44.900924 5044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } }
I20260811 00:50:44.901027 5044 leader_election.cc:302] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70f78affb1df4e91877e30539065b29c; no voters:
I20260811 00:50:44.901203 5044 leader_election.cc:288] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:44.901248 5052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:44.901404 5052 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [term 1 LEADER]: Becoming Leader. State: Replica: 70f78affb1df4e91877e30539065b29c, State: Running, Role: LEADER
I20260811 00:50:44.901485 5044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:44.901530 5052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } }
I20260811 00:50:44.901913 5053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70f78affb1df4e91877e30539065b29c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } } }
I20260811 00:50:44.901996 5053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:44.902185 5070 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:44.902197 5055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70f78affb1df4e91877e30539065b29c. Latest consensus state: current_term: 1 leader_uuid: "70f78affb1df4e91877e30539065b29c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f78affb1df4e91877e30539065b29c" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38603 } } }
I20260811 00:50:44.902359 5055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:44.903831 5070 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:44.905311 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:44.894494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59878 (local address 127.26.99.190:38603)
0811 00:50:44.894647 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:44.894655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:44.894679 (+ 24us) server_negotiation.cc:407] Connection header received
0811 00:50:44.895083 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:44.895089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:44.895134 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:44.895244 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:44.895975 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:44.896956 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:44.897897 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:44.898305 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:44.898387 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:44.901017 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:44.901021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:44.901021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:44.901035 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:44.903621 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:44.904013 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:44.904016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:44.904017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:44.904128 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:44.904354 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:44.904356 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:44.904356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:44.904681 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:44.904848 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:44.904967 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 00:50:44.905112 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
I20260811 00:50:44.905571 5070 catalog_manager.cc:1347] Generated new cluster ID: 29ac131c590c4f1e932a5515e9df3e82
I20260811 00:50:44.905627 5070 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:44.919231 5070 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:44.919839 5070 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:44.925611 5070 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70f78affb1df4e91877e30539065b29c: Generated new TSK 0
I20260811 00:50:44.925781 5070 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:44.958441 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:45.040874 5103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:45.041064 5103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:45.041085 5103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:45.042207 5103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:45.042245 5103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:45.042274 5103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:45.043745 5103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:45.043955 5103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:45.044154 5103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:45.048792 5121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.048797 5115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.048780 5116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:45.048964 5103 server_base.cc:1034] running on GCE node
I20260811 00:50:45.049225 5103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:45.049428 5103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:45.050560 5103 hybrid_clock.cc:648] HybridClock initialized: now 1786409445050542 us; error 34 us; skew 500 ppm
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.052966 5103 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:45.053356 5103 webserver.cc:460] Webserver started at http://127.26.99.129:39227/ using document root <none> and password file <none>
I20260811 00:50:45.053591 5103 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:45.053639 5103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:45.053763 5103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:45.054745 5103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "b389713e45c048359c53137410bd3d23"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "6b08f9fa009e62791e6a1c965c4b24d5"
server_key_iv: "0f62674a7d9fc6c5c59c08af508c5694"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.055068 5103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "b389713e45c048359c53137410bd3d23"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "6b08f9fa009e62791e6a1c965c4b24d5"
server_key_iv: "0f62674a7d9fc6c5c59c08af508c5694"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.056258 5103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:45.056936 5132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.057082 5103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.057155 5103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "b389713e45c048359c53137410bd3d23"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "6b08f9fa009e62791e6a1c965c4b24d5"
server_key_iv: "0f62674a7d9fc6c5c59c08af508c5694"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.057216 5103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:45.073125 5103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:45.074906 5103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:45.075037 5103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:45.075258 5103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:45.075553 5103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:45.075588 5103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.075619 5103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:45.075644 5103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.081296 5103 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:43417
I20260811 00:50:45.081351 5328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:43417 every 8 connection(s)
I20260811 00:50:45.081681 5103 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:45.083416 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 5103
I20260811 00:50:45.083529 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:45.083756 27022 external_mini_cluster.cc:1428] Setting key 4122d3d02ab44853344036bc76610eff
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:45.091599 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.082307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:36757 (local address 127.26.99.190:38603)
0811 00:50:45.082396 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.082399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.082558 (+ 159us) server_negotiation.cc:407] Connection header received
0811 00:50:45.083606 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.083607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.083621 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.083681 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.084437 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.084956 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.086311 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.086609 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.086676 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.088716 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.088718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.088718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.088726 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.090208 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.090628 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.090629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.090630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.090691 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.090931 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.090933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.090933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.091073 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.091147 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.091405 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.091499 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:50:45.091691 5334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.082282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38603 (local address 127.26.99.129:36757)
0811 00:50:45.082435 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:45.082471 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:45.083474 (+ 1003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:45.083763 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:45.083767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:45.084098 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:45.084310 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.084316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.085049 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.085050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.086228 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.086231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.086686 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.086686 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.086782 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.087247 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:45.087256 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:45.088630 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:45.090306 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.090313 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.090315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.090554 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.090760 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.090761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.090761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.090866 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.091145 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:45.091151 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:45.091271 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 00:50:45.091368 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 00:50:45.091513 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":94,"threads_started":1}
I20260811 00:50:45.092211 5331 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38603
I20260811 00:50:45.092301 5331 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:45.092497 5331 heartbeater.cc:511] Master 127.26.99.190:38603 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
I20260811 00:50:45.093042 4989 ts_manager.cc:194] Registered new tserver with Master: b389713e45c048359c53137410bd3d23 (127.26.99.129:43417)
I20260811 00:50:45.093755 4989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:36757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:45.108786 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:45.190902 5344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:45.191114 5344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:45.191144 5344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:45.192399 5344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:45.192441 5344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:45.192468 5344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:45.194008 5344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:45.194240 5344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:45.194491 5344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:45.199501 5344 server_base.cc:1034] running on GCE node
W20260811 00:50:45.199473 5354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.199483 5356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.199503 5352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:45.199889 5344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:45.200140 5344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:45.201300 5344 hybrid_clock.cc:648] HybridClock initialized: now 1786409445201283 us; error 32 us; skew 500 ppm
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.203965 5344 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:45.204407 5344 webserver.cc:460] Webserver started at http://127.26.99.130:43475/ using document root <none> and password file <none>
I20260811 00:50:45.204633 5344 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:45.204679 5344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:45.204805 5344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:45.205834 5344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "4b6276225f2f4810b2105b14ceb16311"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "ca76c9217e9a234bf2bd49454892279e"
server_key_iv: "7536b8a552de77cf7daca402773b4fde"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.206162 5344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "4b6276225f2f4810b2105b14ceb16311"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "ca76c9217e9a234bf2bd49454892279e"
server_key_iv: "7536b8a552de77cf7daca402773b4fde"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.207471 5344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:45.208089 5367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.208244 5344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:45.208330 5344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "4b6276225f2f4810b2105b14ceb16311"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "ca76c9217e9a234bf2bd49454892279e"
server_key_iv: "7536b8a552de77cf7daca402773b4fde"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.208416 5344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:45.220377 5344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:45.222715 5344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:45.222856 5344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:45.223105 5344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:45.223433 5344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:45.223475 5344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.223505 5344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:45.223527 5344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.229372 5344 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:44649
I20260811 00:50:45.229406 5568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:44649 every 8 connection(s)
I20260811 00:50:45.229725 5344 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:45.233660 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 5344
I20260811 00:50:45.233755 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:45.233932 27022 external_mini_cluster.cc:1428] Setting key e05ce30b54b00961d897636f62b80db4
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:45.238746 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.230424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47899 (local address 127.26.99.190:38603)
0811 00:50:45.230489 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.230491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.230685 (+ 194us) server_negotiation.cc:407] Connection header received
0811 00:50:45.231572 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.231573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.231582 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.231637 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.232217 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.232788 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.233796 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.234086 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.234159 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.236191 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.236192 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.236192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.236200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.237439 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.237799 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.237800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.237801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.237856 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.238073 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.238073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.238074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.238186 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.238242 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.238552 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.238643 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:50:45.238942 5575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.230392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38603 (local address 127.26.99.130:47899)
0811 00:50:45.230563 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:45.230605 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:45.231487 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:45.231692 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:45.231695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:45.231940 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:45.232147 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.232151 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.232872 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.232873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.233690 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.233697 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.234178 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.234179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.234326 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.234815 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:45.234823 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:45.236104 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:45.237515 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.237521 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.237524 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.237734 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.237909 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.237910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.237910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.238011 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.238239 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:45.238246 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:45.238379 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 00:50:45.238516 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 00:50:45.238675 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260811 00:50:45.239334 5571 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38603
I20260811 00:50:45.239427 5571 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:45.239605 5571 heartbeater.cc:511] Master 127.26.99.190:38603 requested a full tablet report, sending...
I20260811 00:50:45.239974 4989 ts_manager.cc:194] Registered new tserver with Master: 4b6276225f2f4810b2105b14ceb16311 (127.26.99.130:44649)
I20260811 00:50:45.240355 4989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:47899
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:45.258752 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:45.341428 5579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:45.341638 5579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:45.341674 5579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:45.342819 5579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:45.342859 5579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:45.342893 5579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:45.344319 5579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:38603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:45.344570 5579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:45.344769 5579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:45.349385 5594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.349406 5593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:45.349385 5597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:45.349582 5579 server_base.cc:1034] running on GCE node
I20260811 00:50:45.349772 5579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:45.349954 5579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:45.351089 5579 hybrid_clock.cc:648] HybridClock initialized: now 1786409445351072 us; error 31 us; skew 500 ppm
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.353492 5579 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:45.353870 5579 webserver.cc:460] Webserver started at http://127.26.99.131:37357/ using document root <none> and password file <none>
I20260811 00:50:45.354038 5579 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:45.354075 5579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:45.354168 5579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:45.355123 5579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "5e798421bbd54cfd826deb6fd0c94b0a"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "d67b28eb7f895d5c42a96a67d748aa34"
server_key_iv: "f432af182d1800e42627155abf2394c8"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.355419 5579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "5e798421bbd54cfd826deb6fd0c94b0a"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "d67b28eb7f895d5c42a96a67d748aa34"
server_key_iv: "f432af182d1800e42627155abf2394c8"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.356628 5579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:45.357299 5607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.357452 5579 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:45.357533 5579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "5e798421bbd54cfd826deb6fd0c94b0a"
format_stamp: "Formatted at 2026-08-11 00:50:45 on dist-test-slave-xt4k"
server_key: "d67b28eb7f895d5c42a96a67d748aa34"
server_key_iv: "f432af182d1800e42627155abf2394c8"
server_key_version: "encryptionkey@0"
I20260811 00:50:45.357597 5579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:45.374493 5579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:45.376495 5579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:45.376616 5579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:45.376801 5579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:45.377055 5579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:45.377089 5579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.377108 5579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:45.377125 5579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:45.382524 5579 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:43567
I20260811 00:50:45.382581 5804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:43567 every 8 connection(s)
I20260811 00:50:45.382877 5579 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:45.383906 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 5579
I20260811 00:50:45.384016 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:45.384200 27022 external_mini_cluster.cc:1428] Setting key fc5102c155a377766883404dfd62801e
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:45.391954 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.383542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:38231 (local address 127.26.99.190:38603)
0811 00:50:45.383602 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.383604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.383790 (+ 186us) server_negotiation.cc:407] Connection header received
0811 00:50:45.385003 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.385004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.385017 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.385072 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.385667 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.386189 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.387167 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.387362 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.387416 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.389543 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.389544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.389544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.389551 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.390759 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.391139 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.391140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.391140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.391183 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.391367 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.391368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.391368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.391472 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.391543 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.391805 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.391879 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:45.392076 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.383514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:38603 (local address 127.26.99.131:38231)
0811 00:50:45.383664 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:45.383699 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:45.384901 (+ 1202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:45.385141 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:45.385145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:45.385383 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:45.385567 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.385571 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.386273 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.386274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.387086 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:45.387088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.387422 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.387422 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:45.387515 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.387956 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:45.387964 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:45.389463 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:45.390840 (+ 1377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.390847 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.390849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.391074 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.391226 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:45.391227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:45.391227 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:45.391322 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:45.391535 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:45.391538 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:45.391646 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 00:50:45.391738 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 00:50:45.391856 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260811 00:50:45.392557 5805 heartbeater.cc:347] Connected to a master server at 127.26.99.190:38603
I20260811 00:50:45.392652 5805 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:45.392834 5805 heartbeater.cc:511] Master 127.26.99.190:38603 requested a full tablet report, sending...
I20260811 00:50:45.393190 4989 ts_manager.cc:194] Registered new tserver with Master: 5e798421bbd54cfd826deb6fd0c94b0a (127.26.99.131:43567)
I20260811 00:50:45.393553 4989 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:38231
I20260811 00:50:45.395792 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/test-admin.keytab.
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.412981 27022 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 00:50:45.414431 5818 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:45.413730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46944 (local address 127.26.99.129:43417)
0811 00:50:45.413880 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.413885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.413896 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:45.413927 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.413929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.413942 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.414017 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.414350 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46944: BlockingRecv error: recv got EOF from 127.0.0.1:46944 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260811 00:50:45.414624 27022 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc' of type FILE
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.415462 27022 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.416253 27022 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:45.423229 5818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.416777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.26.99.129:43417)
0811 00:50:45.416818 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.416820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.416828 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:45.416869 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.416869 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.416878 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.416922 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.417259 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.417987 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.418723 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.419041 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.419093 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.420902 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.420911 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.420911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.420918 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.422168 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.422500 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.422502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.422503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.422557 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.422718 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.422719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.422719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.422847 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.422977 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.423052 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.423129 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 00:50:45.424902 5818 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:45.424479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46954 (local address 127.26.99.129:43417)
0811 00:50:45.424529 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.424531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.424553 (+ 22us) server_negotiation.cc:407] Connection header received
0811 00:50:45.424604 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.424605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.424613 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.424654 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.424868 (+ 214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46954: BlockingRecv error: recv got EOF from 127.0.0.1:46954 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 00:50:45.425067 27022 init.cc:244] Error while opening credential cache '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc)
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.425951 27022 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.426728 27022 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:45.432641 5818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.427150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46966 (local address 127.26.99.129:43417)
0811 00:50:45.427204 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.427206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.427214 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:45.427278 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.427279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.427287 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.427325 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.427610 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.428068 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.428745 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.428930 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.428974 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.430663 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.430664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.430665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.430670 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.431770 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.432059 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.432060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.432060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.432100 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.432217 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.432217 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.432217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.432290 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.432395 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.432495 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.432553 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 00:50:45.434151 5818 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:45.433574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46978 (local address 127.26.99.129:43417)
0811 00:50:45.433621 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.433623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.433653 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:50:45.433689 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.433690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.433698 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.433799 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.434108 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46978: BlockingRecv error: recv got EOF from 127.0.0.1:46978 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 00:50:45.434258 27022 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786409417711920-27022-0/krb5kdc/krb5cc' of type FILE
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.435086 27022 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:45.435783 27022 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[4917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:50:45.441974 5818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:45.436219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46982 (local address 127.26.99.129:43417)
0811 00:50:45.436267 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:45.436268 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:45.436312 (+ 44us) server_negotiation.cc:407] Connection header received
0811 00:50:45.436377 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:45.436378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:45.436386 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:45.436429 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:45.436754 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.437220 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.437825 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:45.438000 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:45.438049 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:45.439833 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:45.439834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:45.439834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:45.439841 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:45.441063 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.441356 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.441357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.441357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.441406 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:45.441560 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:45.441561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:45.441562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:45.441649 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:45.441727 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:45.441831 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 00:50:45.441894 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:45.442514 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 5103
I20260811 00:50:45.455685 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 5344
I20260811 00:50:45.465241 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 5579
I20260811 00:50:45.479157 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4935
2026-08-11T00:50:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2010 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[5841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[5841](info): set up 2 sockets
Aug 11 00:50:45 dist-test-slave-xt4k krb5kdc[5841](info): commencing operation
krb5kdc: starting...
W20260811 00:50:46.660805 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:46 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab.
Entry for principal oryx/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab.
I20260811 00:50:46.772616 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:43841
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab
--principal=oryx/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:43841
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:46.855998 5863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:46.856206 5863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:46.856240 5863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:46.857407 5863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:46.857450 5863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:46.857468 5863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:46.857483 5863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:46.857499 5863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:46.858975 5863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:43841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab
--principal=oryx/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:43841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:46.859220 5863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:46.859426 5863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:46.864089 5877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:46.864085 5886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:46.864147 5883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:46.864115 5863 server_base.cc:1034] running on GCE node
I20260811 00:50:46.864550 5863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:46.864821 5863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:46.865962 5863 hybrid_clock.cc:648] HybridClock initialized: now 1786409446865949 us; error 30 us; skew 500 ppm
Aug 11 00:50:46 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:46.868287 5863 init.cc:377] Logged in from keytab as oryx/127.26.99.190@KRBTEST.COM (short username oryx)
I20260811 00:50:46.868685 5863 webserver.cc:460] Webserver started at http://127.26.99.190:33717/ using document root <none> and password file <none>
I20260811 00:50:46.868893 5863 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:46.868942 5863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:46.869072 5863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:46.870064 5863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "dd25cda1b02a432da0552de2e3f73206"
format_stamp: "Formatted at 2026-08-11 00:50:46 on dist-test-slave-xt4k"
server_key: "f9dbffbbeab517f85d4f6ad1755b789c"
server_key_iv: "cdf5822de769d01c160af1b477c200f3"
server_key_version: "encryptionkey@0"
I20260811 00:50:46.870378 5863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "dd25cda1b02a432da0552de2e3f73206"
format_stamp: "Formatted at 2026-08-11 00:50:46 on dist-test-slave-xt4k"
server_key: "f9dbffbbeab517f85d4f6ad1755b789c"
server_key_iv: "cdf5822de769d01c160af1b477c200f3"
server_key_version: "encryptionkey@0"
I20260811 00:50:46.871688 5863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:46.872301 5899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:46.872442 5863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:46.872525 5863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "dd25cda1b02a432da0552de2e3f73206"
format_stamp: "Formatted at 2026-08-11 00:50:46 on dist-test-slave-xt4k"
server_key: "f9dbffbbeab517f85d4f6ad1755b789c"
server_key_iv: "cdf5822de769d01c160af1b477c200f3"
server_key_version: "encryptionkey@0"
I20260811 00:50:46.872586 5863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:46.890013 5863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:46.891811 5863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:46.891954 5863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:46.895684 5863 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:43841
I20260811 00:50:46.895725 5991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:43841 every 8 connection(s)
I20260811 00:50:46.896055 5863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:46.897009 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 5863
I20260811 00:50:46.897051 5992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:46.897118 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:46.897323 27022 external_mini_cluster.cc:1428] Setting key d3f1d591c09f3dd2776540fb5f7152b6
I20260811 00:50:46.900130 5992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Bootstrap starting.
I20260811 00:50:46.900852 5992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:46.901156 5992 log.cc:824] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:46.901851 5992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: No bootstrap required, opened a new log
Aug 11 00:50:46 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:46.903878 5992 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } }
I20260811 00:50:46.904047 5992 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:46.904102 5992 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd25cda1b02a432da0552de2e3f73206, State: Initialized, Role: FOLLOWER
I20260811 00:50:46.904228 5992 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } }
I20260811 00:50:46.904315 5992 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:46.904377 5992 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:46.904449 5992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:46.905118 5992 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } }
I20260811 00:50:46.905233 5992 leader_election.cc:302] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd25cda1b02a432da0552de2e3f73206; no voters:
I20260811 00:50:46.905387 5992 leader_election.cc:288] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:46.905416 5999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:46.905527 5999 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 LEADER]: Becoming Leader. State: Replica: dd25cda1b02a432da0552de2e3f73206, State: Running, Role: LEADER
I20260811 00:50:46.905654 5992 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:46.905674 5999 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } }
I20260811 00:50:46.906026 5999 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd25cda1b02a432da0552de2e3f73206. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } }
I20260811 00:50:46.906183 5999 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:46.906440 6019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:46.906504 6002 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } }
I20260811 00:50:46.906579 6002 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:46.907024 6019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:46.908114 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:46.897883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49660 (local address 127.26.99.190:43841)
0811 00:50:46.898047 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:46.898055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:46.898080 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:50:46.898512 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:46.898519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:46.898563 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:46.898672 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:46.899407 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:46.900389 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:46.901375 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:46.901870 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:46.901980 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:46.904464 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:46.904469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:46.904469 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:46.904481 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:46.906436 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:46.906833 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:46.906836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:46.906837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:46.906940 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:46.907196 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:46.907197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:46.907197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:46.907495 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:46.907652 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:46.907787 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 00:50:46.907923 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260811 00:50:46.908772 6019 catalog_manager.cc:1347] Generated new cluster ID: 5492a805cd6f4399828c34963da2a0e1
I20260811 00:50:46.908828 6019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:46.916314 6019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:46.916990 6019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:46.927727 6019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Generated new TSK 0
I20260811 00:50:46.927912 6019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
I20260811 00:50:46.956532 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:47.037958 6039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:47.038164 6039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:47.038187 6039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:47.039650 6039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:47.039710 6039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:47.039748 6039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:47.041731 6039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:47.041989 6039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:47.042215 6039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:47.047052 6039 server_base.cc:1034] running on GCE node
W20260811 00:50:47.047008 6048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.047021 6047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.047021 6050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.047365 6039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.047590 6039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.048720 6039 hybrid_clock.cc:648] HybridClock initialized: now 1786409447048711 us; error 32 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.051249 6039 init.cc:377] Logged in from keytab as oryx/127.26.99.129@KRBTEST.COM (short username oryx)
I20260811 00:50:47.051635 6039 webserver.cc:460] Webserver started at http://127.26.99.129:35113/ using document root <none> and password file <none>
I20260811 00:50:47.051833 6039 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.051874 6039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.051959 6039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:47.052997 6039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "d9638f71383a48bc90e230436eb7c5be"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "82166094f76bb12ce5ab7607f9ccaceb"
server_key_iv: "1f7f0510b5f8b576e07207ee2cc22d23"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.053298 6039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "d9638f71383a48bc90e230436eb7c5be"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "82166094f76bb12ce5ab7607f9ccaceb"
server_key_iv: "1f7f0510b5f8b576e07207ee2cc22d23"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.054478 6039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:47.055135 6064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.055305 6039 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:47.055387 6039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "d9638f71383a48bc90e230436eb7c5be"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "82166094f76bb12ce5ab7607f9ccaceb"
server_key_iv: "1f7f0510b5f8b576e07207ee2cc22d23"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.055444 6039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.079967 6039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.081845 6039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:47.081965 6039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.082160 6039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:47.082482 6039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:47.082518 6039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.082540 6039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:47.082562 6039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.088033 6039 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36603
I20260811 00:50:47.088096 6289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36603 every 8 connection(s)
I20260811 00:50:47.088421 6039 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:47.091562 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 6039
I20260811 00:50:47.091656 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:47.091876 27022 external_mini_cluster.cc:1428] Setting key a83c4abedd419b06cf815c2dd3e686c1
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:47.098286 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.089145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:37045 (local address 127.26.99.190:43841)
0811 00:50:47.089191 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.089193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.089410 (+ 217us) server_negotiation.cc:407] Connection header received
0811 00:50:47.090024 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.090025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.090039 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.090109 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.091140 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.091833 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.093004 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.093289 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.093361 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.095402 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.095403 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.095403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.095411 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.096781 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.097258 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.097260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.097260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.097328 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.097621 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.097622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.097622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.097736 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.097788 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.098132 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.098217 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:47.098490 6296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.089092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:37045)
0811 00:50:47.089296 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.089331 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.089901 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.090178 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.090182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.090837 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.091042 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.091047 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.091918 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.091919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.092918 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.092921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.093362 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.093362 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.093466 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.093945 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.093953 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.095266 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.096868 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.096876 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.096879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.097169 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.097400 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.097400 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.097401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.097551 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.097797 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.097803 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.097969 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.098091 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.098263 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":113,"threads_started":1}
I20260811 00:50:47.099094 6290 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:47.099184 6290 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:47.099354 6290 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:47.099867 5918 ts_manager.cc:194] Registered new tserver with Master: d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:47.100512 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:37045
WARNING: no policy specified for oryx/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
I20260811 00:50:47.116961 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:47.198513 6300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:47.198714 6300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:47.198735 6300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:47.199869 6300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:47.199919 6300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:47.199950 6300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:47.201476 6300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:47.201691 6300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:47.201897 6300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:47.206602 6313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.206602 6317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.206596 6319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.206892 6300 server_base.cc:1034] running on GCE node
I20260811 00:50:47.207080 6300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.207311 6300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.208461 6300 hybrid_clock.cc:648] HybridClock initialized: now 1786409447208452 us; error 27 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.210806 6300 init.cc:377] Logged in from keytab as oryx/127.26.99.130@KRBTEST.COM (short username oryx)
I20260811 00:50:47.211174 6300 webserver.cc:460] Webserver started at http://127.26.99.130:46661/ using document root <none> and password file <none>
I20260811 00:50:47.211367 6300 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.211416 6300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.211508 6300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:47.212582 6300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "1760bf948aed407d91dde79eba1cf0bc"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "7d52e8cdca7a00390889428f15403d6e"
server_key_iv: "cd7b5197b43aafab1b9e5d932a835af9"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.212873 6300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "1760bf948aed407d91dde79eba1cf0bc"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "7d52e8cdca7a00390889428f15403d6e"
server_key_iv: "cd7b5197b43aafab1b9e5d932a835af9"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.214007 6300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:47.214640 6330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.214802 6300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:47.214866 6300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "1760bf948aed407d91dde79eba1cf0bc"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "7d52e8cdca7a00390889428f15403d6e"
server_key_iv: "cd7b5197b43aafab1b9e5d932a835af9"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.214931 6300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.226060 6300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.227720 6300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:47.227843 6300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.228057 6300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:47.228376 6300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:47.228415 6300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.228437 6300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:47.228461 6300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.233858 6300 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:35833
I20260811 00:50:47.233919 6549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:35833 every 8 connection(s)
I20260811 00:50:47.234205 6300 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:47.241828 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 6300
I20260811 00:50:47.241936 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:47.242108 27022 external_mini_cluster.cc:1428] Setting key 5778c2e7e0502a1322a368a53f6a1744
I20260811 00:50:47.242702 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.234917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:39995 (local address 127.26.99.190:43841)
0811 00:50:47.234965 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.234967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.235150 (+ 183us) server_negotiation.cc:407] Connection header received
0811 00:50:47.235656 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.235658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.235670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.235723 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.236662 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.237163 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.238130 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.238318 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.238374 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.240315 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.240317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.240317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.240326 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.241426 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.241798 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.241800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.241800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.241853 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.242079 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.242080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.242081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.242210 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.242266 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.242531 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.242616 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:47.242851 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.234866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:39995)
0811 00:50:47.235037 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.235073 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.235554 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.235804 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.235808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.236371 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.236561 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.236565 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.237243 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.237243 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.238041 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.238043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.238385 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.238386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.238508 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.238961 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.238969 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.240230 (+ 1261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.241495 (+ 1265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.241502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.241504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.241733 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.241905 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.241905 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.241906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.242029 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.242269 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.242276 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.242413 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.242498 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.242654 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260811 00:50:47.243247 6550 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:47.243350 6550 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:47.243537 6550 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:47.243952 5918 ts_manager.cc:194] Registered new tserver with Master: 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833)
I20260811 00:50:47.244302 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:39995
WARNING: no policy specified for oryx/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
I20260811 00:50:47.266465 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:47.350910 6562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:47.351132 6562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:47.351168 6562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:47.352329 6562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:47.352394 6562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:47.352419 6562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:47.354054 6562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:43841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:47.354358 6562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:47.354581 6562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:47.359858 6576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.359874 6568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.360175 6562 server_base.cc:1034] running on GCE node
W20260811 00:50:47.360208 6570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.360440 6562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.360674 6562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.361908 6562 hybrid_clock.cc:648] HybridClock initialized: now 1786409447361890 us; error 31 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.364476 6562 init.cc:377] Logged in from keytab as oryx/127.26.99.131@KRBTEST.COM (short username oryx)
I20260811 00:50:47.364914 6562 webserver.cc:460] Webserver started at http://127.26.99.131:41555/ using document root <none> and password file <none>
I20260811 00:50:47.365139 6562 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.365187 6562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.365314 6562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:47.366359 6562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "a6fe31fb3caa22fd57d1e2a91d52a84e"
server_key_iv: "a15ff84a031893793fdd86b80dc49935"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.366707 6562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "a6fe31fb3caa22fd57d1e2a91d52a84e"
server_key_iv: "a15ff84a031893793fdd86b80dc49935"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.368027 6562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:47.368947 6587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.369129 6562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:47.369220 6562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "a6fe31fb3caa22fd57d1e2a91d52a84e"
server_key_iv: "a15ff84a031893793fdd86b80dc49935"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.369290 6562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.376957 6562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.378980 6562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:47.379115 6562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.379319 6562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:47.379719 6562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:47.379771 6562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.379805 6562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:47.379827 6562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.385461 6562 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39907
I20260811 00:50:47.385525 6795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39907 every 8 connection(s)
I20260811 00:50:47.385820 6562 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:47.391948 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 6562
I20260811 00:50:47.392061 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:47.392269 27022 external_mini_cluster.cc:1428] Setting key 8cd41bd1168008d77dfbc88337788264
I20260811 00:50:47.395077 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.386499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:38919 (local address 127.26.99.190:43841)
0811 00:50:47.386545 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.386547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.386775 (+ 228us) server_negotiation.cc:407] Connection header received
0811 00:50:47.387231 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.387232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.387243 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.387304 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.388238 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.388811 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.389801 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.389994 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.390055 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.392283 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.392285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.392285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.392292 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.393722 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.394158 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.394159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.394160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.394221 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.394463 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.394464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.394465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.394585 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.394643 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.394901 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.394990 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:47.395251 6805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.386448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:38919)
0811 00:50:47.386629 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.386671 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.387149 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.387373 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.387376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.387947 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.388164 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.388170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.388893 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.388894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.389719 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.389722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.390062 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.390062 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.390163 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.390688 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.390697 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.392179 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.393797 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.393804 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.393806 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.394089 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.394273 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.394274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.394274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.394383 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.394640 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.394647 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.394785 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.394873 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.395034 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260811 00:50:47.395679 6802 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:47.395783 6802 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:47.395944 6802 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:47.396384 5918 ts_manager.cc:194] Registered new tserver with Master: 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:47.396770 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:38919
I20260811 00:50:47.404109 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.99.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.189.keytab.
Entry for principal oryx/127.26.99.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.189.keytab.
I20260811 00:50:47.430560 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:39221
--webserver_interface=127.26.99.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.189.keytab
--principal=oryx/127.26.99.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:43841,127.26.99.189:39221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:47.525249 6812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:47.525452 6812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:47.525483 6812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:47.526587 6812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:47.526625 6812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:47.526645 6812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:47.526661 6812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:47.526677 6812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:47.528385 6812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:43841,127.26.99.189:39221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.189.keytab
--principal=oryx/127.26.99.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:39221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.99.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
W20260811 00:50:47.528514 6812 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.99.190:43841,127.26.99.189:39221'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 00:50:47.528663 6812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:47.528872 6812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:47.533509 6822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.533540 6819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.533572 6812 server_base.cc:1034] running on GCE node
W20260811 00:50:47.533540 6825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.533915 6812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.534178 6812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.535318 6812 hybrid_clock.cc:648] HybridClock initialized: now 1786409447535296 us; error 38 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.537761 6812 init.cc:377] Logged in from keytab as oryx/127.26.99.189@KRBTEST.COM (short username oryx)
I20260811 00:50:47.538159 6812 webserver.cc:460] Webserver started at http://127.26.99.189:43167/ using document root <none> and password file <none>
I20260811 00:50:47.538370 6812 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.538419 6812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.538544 6812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:47.539542 6812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/instance:
uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "3552127472759df9871f040ce4c73d3d"
server_key_iv: "467fa1d9c4010c7b47b9f7a79243ab3f"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.539875 6812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal/instance:
uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "3552127472759df9871f040ce4c73d3d"
server_key_iv: "467fa1d9c4010c7b47b9f7a79243ab3f"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.541138 6812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:47.541777 6840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.541925 6812 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:47.542008 6812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "3552127472759df9871f040ce4c73d3d"
server_key_iv: "467fa1d9c4010c7b47b9f7a79243ab3f"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.542068 6812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.554145 6812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.556093 6812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:47.556222 6812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.560521 6812 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.189:39221
I20260811 00:50:47.560578 6939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.189:39221 every 8 connection(s)
I20260811 00:50:47.560885 6812 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
I20260811 00:50:47.561892 6943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:47.563469 6943 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.189@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:47.569576 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 6812
I20260811 00:50:47.572170 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.564130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49666 (local address 127.26.99.190:43841)
0811 00:50:47.564210 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.564213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.564442 (+ 229us) server_negotiation.cc:407] Connection header received
0811 00:50:47.564871 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.564872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.564882 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.564933 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.565506 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.566002 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.566977 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.567169 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.567219 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.569172 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.569174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.569174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.569181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.570716 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.571157 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.571157 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.571158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.571205 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.571444 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.571444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.571445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.571662 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.571737 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.571992 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.572074 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:50:47.572543 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.564095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49666)
0811 00:50:47.564303 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.564363 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.564793 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.564990 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.564993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.565253 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.565443 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.565447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.566074 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.566075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.566910 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.566912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.567226 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.567226 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.567334 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.567729 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.567737 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.569075 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.570796 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.570803 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.570806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.571089 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.571257 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.571258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.571259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.571385 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.571750 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.571755 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.571872 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.571954 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.572193 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":105,"thread_start_us":133,"threads_started":1}
I20260811 00:50:47.573292 6943 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.189@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:47.578860 6954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.570217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33718 (local address 127.26.99.189:39221)
0811 00:50:47.570413 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.570419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.570445 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:50:47.570467 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.570469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.570483 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.570568 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.571327 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.572378 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.573230 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.573660 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.573719 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.576115 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.576123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.576123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.576130 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.577804 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.578103 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.578106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.578106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.578160 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.578332 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.578333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.578333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.578467 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.578624 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.578690 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.578763 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260811 00:50:47.580192 6949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.573525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33724)
0811 00:50:47.573571 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.573582 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.573625 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.573802 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.573802 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.573920 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.573962 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.573964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.574623 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.574624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.575338 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.575341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.575735 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.575736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.575839 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.576158 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.576162 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.577516 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.579476 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.579477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.579477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.579651 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.579795 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.579795 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.579795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.579835 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.579995 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.579996 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.580025 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.580067 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.580136 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 00:50:47.580307 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.573558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.26.99.189:39221)
0811 00:50:47.573683 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.573685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.573691 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:50:47.573710 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.573711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.573724 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.573792 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.574020 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.574545 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.575410 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.575635 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.575691 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.577591 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.577592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.577592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.577598 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.579412 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.579706 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.579707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.579707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.579757 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.579868 (+ 111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.579869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.579869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.579954 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.579996 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.580084 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.580180 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260811 00:50:47.581496 6943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Bootstrap starting.
I20260811 00:50:47.582057 6943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:47.582283 6943 log.cc:824] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:47.583694 6943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: No bootstrap required, opened a new log
I20260811 00:50:47.585078 6943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } }
I20260811 00:50:47.585198 6943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:47.585225 6943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0b4d7a572847ddb2ca6aa0545eadbf, State: Initialized, Role: FOLLOWER
I20260811 00:50:47.585317 6943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } }
I20260811 00:50:47.585577 6943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:47.585543 6957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } } }
I20260811 00:50:47.585644 6957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:50:47.587203 6979 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:47.587262 6979 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:47.588949 6812 master_runner.cc:428] Detected that this master 0f0b4d7a572847ddb2ca6aa0545eadbf is joining an existing cluster
I20260811 00:50:47.589025 6812 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.99.189:39221
I20260811 00:50:47.596283 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.589965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49668 (local address 127.26.99.190:43841)
0811 00:50:47.590004 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.590006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.590224 (+ 218us) server_negotiation.cc:407] Connection header received
0811 00:50:47.590286 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.590287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.590297 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.590335 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.590714 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.591485 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592487 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.592689 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592745 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.593775 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.593777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.593777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.593784 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.595183 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.595530 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.595531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.595532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.595592 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.595753 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.595754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.595754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.595882 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.595944 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.596120 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.596191 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:47.596299 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.589909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49668)
0811 00:50:47.590159 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.590168 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.590223 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.590348 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.590348 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.590542 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.590615 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.590617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.591559 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.591560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.592378 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.592380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.592749 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.592812 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.593249 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.593254 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.593668 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.595254 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.595255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.595255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.595469 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.595644 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.595644 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.595645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.595703 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.595973 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.595974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.596016 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.596094 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.596191 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":206,"threads_started":1}
I20260811 00:50:47.596920 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.590485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33738 (local address 127.26.99.189:39221)
0811 00:50:47.590516 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.590518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.590526 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:47.590574 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.590575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.590584 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.590643 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.590913 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.591380 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592431 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.592765 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592828 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.593801 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.593803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.593803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.593810 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.595723 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.596064 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.596064 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.596065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.596123 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.596313 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.596314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.596314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.596454 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.596496 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.596757 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.596835 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:50:47.597203 6996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.590254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33738)
0811 00:50:47.590465 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.590474 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.590518 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.590659 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.590660 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.590804 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.590850 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.590851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.591444 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.591445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.592326 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.592329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.592840 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.592840 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.592896 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.593411 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.593415 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.593722 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.595803 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.595803 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.595804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.595999 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.596194 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.596195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.596195 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.596253 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.596598 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.596599 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.596646 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.597020 (+ 374us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.597107 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":160,"threads_started":1}
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.190@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:47.605762 6955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.598625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33748 (local address 127.26.99.189:39221)
0811 00:50:47.598674 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.598676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.598767 (+ 91us) server_negotiation.cc:407] Connection header received
0811 00:50:47.598882 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.598883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.598891 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.598925 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.599413 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.599866 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.601028 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.601203 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.601250 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.603305 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.603307 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.603307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.603314 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.604667 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.605015 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.605016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.605016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.605070 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.605234 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.605235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.605235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.605344 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.605398 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.605608 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.605673 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:47.605780 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.598526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33748)
0811 00:50:47.598658 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.598707 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.598802 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.598934 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.598936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.599273 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.599335 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.599337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.599935 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.599937 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.600936 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.600939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.601264 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.601265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.601350 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.601732 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.601736 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.603221 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.604743 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.604751 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.604753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.604947 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.605126 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.605127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.605127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.605185 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.605400 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.605408 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.605463 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.605543 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.605674 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260811 00:50:47.606374 5918 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.99.189:39221: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
member_type: NON_VOTER
last_known_addr {
host: "127.26.99.189"
port: 39221
}
attrs {
promote: true
}
}
dest_uuid: "dd25cda1b02a432da0552de2e3f73206"
cas_config_opid_index: -1
I20260811 00:50:47.606771 5918 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } }
I20260811 00:50:47.607317 7002 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } }
I20260811 00:50:47.607512 6895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:47.608304 6895 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Refusing update from remote peer dd25cda1b02a432da0552de2e3f73206: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 00:50:47.608376 7002 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.99.189:39221
I20260811 00:50:47.608525 7002 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } }
I20260811 00:50:47.608596 7002 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:47.608752 6812 master.cc:537] Master@127.26.99.189:39221 shutting down...
I20260811 00:50:47.608785 7002 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 00:50:47.609483 5903 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 00:50:47.610389 5903 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 -> Peer 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221): Couldn't send request to peer 0f0b4d7a572847ddb2ca6aa0545eadbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 00:50:47.611455 6812 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:47.611534 6812 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:47.611584 6812 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: stopping tablet replica
I20260811 00:50:47.625339 6812 master.cc:552] Master@127.26.99.189:39221 shutdown complete.
I20260811 00:50:47.625401 6812 master_runner.cc:305] Clearing existing system tablet
I20260811 00:50:47.625541 6812 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.625592 6812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.626300 6812 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260811 00:50:47.626837 7010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.626959 6812 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.627022 6812 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.627046 6812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "3552127472759df9871f040ce4c73d3d"
server_key_iv: "467fa1d9c4010c7b47b9f7a79243ab3f"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.627956 6812 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:47.629539 6812 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 00:50:47.629612 6812 log.cc:1196] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 00:50:47.629824 6812 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Deleting consensus metadata
I20260811 00:50:47.629946 6812 master_runner.cc:315] Copying system tablet from 127.26.99.190:43841
I20260811 00:50:47.630589 6812 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: tablet copy: Beginning tablet copy session from remote peer at address 127.26.99.190:43841
I20260811 00:50:47.636858 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.630967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49682 (local address 127.26.99.190:43841)
0811 00:50:47.631018 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.631020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.631059 (+ 39us) server_negotiation.cc:407] Connection header received
0811 00:50:47.631114 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.631114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.631125 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.631203 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.631481 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.632271 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.633042 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.633350 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.633421 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.634278 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.634280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.634281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.634289 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.635762 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.636078 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.636079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.636079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.636139 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.636323 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.636324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.636324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.636480 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.636544 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.636693 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.636771 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:50:47.636873 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.630876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49682)
0811 00:50:47.631000 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.631009 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.631067 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.631208 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.631208 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.631368 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.631424 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.631426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.632401 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.632402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.632970 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.632972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.633415 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.633416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.633460 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.633910 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.633915 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.634196 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.635837 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.635838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.635839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.636013 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.636198 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.636198 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.636199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.636245 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.636543 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.636544 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.636598 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.636657 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.636761 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260811 00:50:47.637226 5955 tablet_copy_service.cc:140] P dd25cda1b02a432da0552de2e3f73206: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0f0b4d7a572847ddb2ca6aa0545eadbf ({username='oryx', principal='oryx/127.26.99.189@KRBTEST.COM'} at 127.0.0.1:49682)
I20260811 00:50:47.637351 5955 tablet_copy_service.cc:161] P dd25cda1b02a432da0552de2e3f73206: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0f0b4d7a572847ddb2ca6aa0545eadbf at {username='oryx', principal='oryx/127.26.99.189@KRBTEST.COM'} at 127.0.0.1:49682: session id = 0f0b4d7a572847ddb2ca6aa0545eadbf-00000000000000000000000000000000
I20260811 00:50:47.638130 5955 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 00:50:47.638758 6812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 00:50:47.640049 6812 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: tablet copy: Starting download of 0 data blocks...
I20260811 00:50:47.640196 6812 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: tablet copy: Starting download of 1 WAL segments...
I20260811 00:50:47.641171 6812 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 00:50:47.642032 5955 tablet_copy_service.cc:342] P dd25cda1b02a432da0552de2e3f73206: Request end of tablet copy session 0f0b4d7a572847ddb2ca6aa0545eadbf-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.99.189@KRBTEST.COM'} at 127.0.0.1:49682
I20260811 00:50:47.642086 5955 tablet_copy_service.cc:433] P dd25cda1b02a432da0552de2e3f73206: ending tablet copy session 0f0b4d7a572847ddb2ca6aa0545eadbf-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0f0b4d7a572847ddb2ca6aa0545eadbf
I20260811 00:50:47.644618 6812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:47.645700 7024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.645830 6812 server_base.cc:1034] running on GCE node
W20260811 00:50:47.645897 7027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.645985 7021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.646086 6812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.646207 6812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.647325 6812 hybrid_clock.cc:648] HybridClock initialized: now 1786409447647313 us; error 28 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.648526 6812 init.cc:377] Logged in from keytab as oryx/127.26.99.189@KRBTEST.COM (short username oryx)
I20260811 00:50:47.648782 6812 webserver.cc:460] Webserver started at http://127.26.99.189:43875/ using document root <none> and password file <none>
I20260811 00:50:47.648888 6812 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.648922 6812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.649475 6812 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:47.649928 7036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.650031 6812 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.650086 6812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "3552127472759df9871f040ce4c73d3d"
server_key_iv: "467fa1d9c4010c7b47b9f7a79243ab3f"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.650139 6812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.669170 6812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.670681 6812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.674678 6812 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.189:39221
I20260811 00:50:47.674695 7146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.189:39221 every 8 connection(s)
I20260811 00:50:47.675052 6812 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
I20260811 00:50:47.676028 7147 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:50:47.676630 7147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Bootstrap starting.
I20260811 00:50:47.679749 7147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:50:47.679967 7147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: Bootstrap complete.
I20260811 00:50:47.680202 7147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } }
I20260811 00:50:47.680292 7147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0f0b4d7a572847ddb2ca6aa0545eadbf, State: Initialized, Role: LEARNER
I20260811 00:50:47.680330 7147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } }
I20260811 00:50:47.680534 7147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:47.680721 7155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } }
I20260811 00:50:47.680814 7155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: LEARNER
I20260811 00:50:47.682147 7173 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:50:47.687369 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.680270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33758 (local address 127.26.99.189:39221)
0811 00:50:47.680504 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.680506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.680513 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:47.680535 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.680536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.680547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.680637 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.681273 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.682114 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.683032 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.683330 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.683392 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.684785 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.684787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.684787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.684793 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.686305 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.686694 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.686694 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.686695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.686745 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.686928 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.686928 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.686928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.687023 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.687107 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.687239 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.687301 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":210,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for oryx/127.26.99.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.188.keytab.
Entry for principal oryx/127.26.99.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.188.keytab.
I20260811 00:50:47.712244 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:36089
--webserver_interface=127.26.99.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.188.keytab
--principal=oryx/127.26.99.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:47.795910 7177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:47.796124 7177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:47.796155 7177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:47.797335 7177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:47.797380 7177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:47.797400 7177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:47.797417 7177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:47.797433 7177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:47.798965 7177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.188.keytab
--principal=oryx/127.26.99.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:36089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.99.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:47.799202 7177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:47.799402 7177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:47.804020 7184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.804010 7185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:47.804020 7187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:47.804247 7177 server_base.cc:1034] running on GCE node
I20260811 00:50:47.804576 7177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:47.804855 7177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:47.805984 7177 hybrid_clock.cc:648] HybridClock initialized: now 1786409447805973 us; error 28 us; skew 500 ppm
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:47.808492 7177 init.cc:377] Logged in from keytab as oryx/127.26.99.188@KRBTEST.COM (short username oryx)
I20260811 00:50:47.808897 7177 webserver.cc:460] Webserver started at http://127.26.99.188:44599/ using document root <none> and password file <none>
I20260811 00:50:47.809114 7177 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.809167 7177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.809290 7177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:47.810335 7177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/instance:
uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "9f7f1455cd5703d38297aae0a494edd8"
server_key_iv: "911b138d418568166305e46bec34d430"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.810670 7177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal/instance:
uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "9f7f1455cd5703d38297aae0a494edd8"
server_key_iv: "911b138d418568166305e46bec34d430"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.812217 7177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:47.812944 7201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.813092 7177 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.813169 7177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "9f7f1455cd5703d38297aae0a494edd8"
server_key_iv: "911b138d418568166305e46bec34d430"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.813238 7177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.825464 7177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:47.827811 7177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:47.827972 7177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:47.832886 7177 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.188:36089
I20260811 00:50:47.832929 7298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.188:36089 every 8 connection(s)
I20260811 00:50:47.833279 7177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
I20260811 00:50:47.834259 7299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:47.835908 7299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:50:47.837651 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 7177
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.188@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
I20260811 00:50:47.845953 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.836766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49684 (local address 127.26.99.190:43841)
0811 00:50:47.836826 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.836829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.836919 (+ 90us) server_negotiation.cc:407] Connection header received
0811 00:50:47.837441 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.837442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.837455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.837514 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.838352 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.838881 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.839941 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.840203 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.840254 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.842785 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.842787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.842787 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.842796 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.844116 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.844688 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.844691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.844692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.844844 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.845231 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.845233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.845233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.845411 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.845522 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.845809 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.845883 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:47.846182 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.836604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49684)
0811 00:50:47.836775 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.836823 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.837341 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.837619 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.837622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.837919 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.838214 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.838221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.838982 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.838983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.839860 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.839863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.840314 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.840316 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.840520 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.841012 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.841020 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.842703 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.844198 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.844206 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.844209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.844539 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.844963 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.844964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.844964 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.845094 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.845488 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.845496 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.845668 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.845769 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.845936 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260811 00:50:47.846447 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.838285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44490 (local address 127.26.99.188:36089)
0811 00:50:47.838487 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.838490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.838505 (+ 15us) server_negotiation.cc:407] Connection header received
0811 00:50:47.838522 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.838523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.838539 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.838598 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.839207 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.840032 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.840932 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.841240 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.841296 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.843478 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.843486 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.843487 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.843494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.845135 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.845531 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.845534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.845534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.845596 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.845794 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.845794 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.845795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.846010 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.846205 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.846281 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.846358 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":105,"threads_started":1}
I20260811 00:50:47.846751 7299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.188@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:47.852938 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.847009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33760)
0811 00:50:47.847053 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.847063 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.847096 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.847241 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.847242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.847365 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.847423 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.847425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.848042 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.848043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.848560 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.848563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.848908 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.848909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.848977 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.849297 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.849301 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.850506 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.852010 (+ 1504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.852011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.852011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.852180 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.852433 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.852434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.852434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.852484 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.852716 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.852717 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.852760 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.852810 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.852877 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:50:47.852972 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.847081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33760 (local address 127.26.99.189:39221)
0811 00:50:47.847142 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.847145 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.847153 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:47.847177 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.847178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.847192 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.847238 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.847494 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.847975 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.848639 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.848853 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.848917 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.850606 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.850608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.850608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.850615 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.851938 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.852268 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.852269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.852269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.852329 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.852528 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.852529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.852529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.852644 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.852708 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.852829 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.852901 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:47.853304 7299 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409447, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.188@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
I20260811 00:50:47.858633 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.853542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44506)
0811 00:50:47.853590 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.853600 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.853641 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.853747 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.853748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.853851 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.853883 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.853884 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.854438 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.854456 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.854914 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.854916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.855207 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.855208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.855240 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.855562 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.855567 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.856619 (+ 1052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.857817 (+ 1198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.857818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.857818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.857978 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.858118 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.858118 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.858119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.858165 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.858351 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.858352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.858391 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.858443 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.858533 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:50:47.858678 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.853598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.26.99.188:36089)
0811 00:50:47.853633 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.853635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.853641 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:50:47.853691 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.853692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.853700 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.853739 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.853927 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.854375 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.854974 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.855164 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.855205 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.856682 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.856683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.856683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.856689 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.857738 (+ 1049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.858036 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.858036 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.858037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.858076 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.858203 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.858204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.858204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.858303 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.858343 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.858457 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.858571 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":18}
I20260811 00:50:47.860101 7299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Bootstrap starting.
I20260811 00:50:47.860999 7299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:47.861277 7299 log.cc:824] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:47.862118 7299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: No bootstrap required, opened a new log
I20260811 00:50:47.863691 7299 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } }
I20260811 00:50:47.863816 7299 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:47.863849 7299 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd72eaf4a3c04fb7b41ae580d0e70a78, State: Initialized, Role: FOLLOWER
I20260811 00:50:47.863983 7299 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } }
I20260811 00:50:47.864264 7299 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:47.864228 7304 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } } }
I20260811 00:50:47.864310 7304 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:50:47.865911 7329 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:47.865967 7329 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:47.868161 7177 master_runner.cc:428] Detected that this master dd72eaf4a3c04fb7b41ae580d0e70a78 is joining an existing cluster
I20260811 00:50:47.868204 7177 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.99.188:36089
I20260811 00:50:47.876441 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.26.99.189:39221)
0811 00:50:47.869811 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.869813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.870047 (+ 234us) server_negotiation.cc:407] Connection header received
0811 00:50:47.870138 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.870138 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.870149 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.870179 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.870807 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.871497 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.872694 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.873012 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.873053 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.874108 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.874109 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.874109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.874116 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.875369 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.875698 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.875699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.875700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.875758 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.875921 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.875922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.875922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.876039 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.876092 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.876249 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.876319 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:50:47.876451 7344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33764)
0811 00:50:47.870000 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.870007 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.870069 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.870245 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.870245 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.870683 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.870732 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.870734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.871583 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.871584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.872596 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.872599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.873177 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.873177 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.873232 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.873687 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.873692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.874027 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.875442 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.875443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.875444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.875636 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.875809 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.875810 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.875811 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.875869 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.876093 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.876094 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.876162 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.876218 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.876320 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":117,"thread_start_us":73,"threads_started":1}
I20260811 00:50:47.896485 7304 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:47.897308 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49690 (local address 127.26.99.190:43841)
0811 00:50:47.869223 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.869225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.870123 (+ 898us) server_negotiation.cc:407] Connection header received
0811 00:50:47.870146 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.870146 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.870156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.870201 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.870686 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.871482 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.872694 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.873012 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.873055 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.893468 (+ 20413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.893470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.893470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.893479 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.895101 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.895923 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.895924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.895924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.895981 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.896183 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.896183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.896184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.896318 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.896625 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.897124 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.897210 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:47.896961 7304 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } }
I20260811 00:50:47.898110 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 6039
I20260811 00:50:47.898104 5940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd25cda1b02a432da0552de2e3f73206" is_pre_election: true
I20260811 00:50:47.955600 7304 leader_election.cc:288] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221)
I20260811 00:50:47.956470 7345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49690)
0811 00:50:47.869862 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.869872 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.869925 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.870245 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.870245 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.870498 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.870602 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.870604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.871576 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.871577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.872597 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.872599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.873165 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.873166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.873231 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.892889 (+ 19658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.892895 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.893316 (+ 421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.895194 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.895194 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.895195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.895824 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.896055 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.896056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.896056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.896115 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.896734 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.896735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.896785 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.955726 (+ 58941us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.956364 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"mutex_wait_us":9,"thread_start_us":85,"threads_started":1}
I20260811 00:50:47.958281 7092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" is_pre_election: true
I20260811 00:50:47.958562 7092 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Handling vote request from an unknown peer dd72eaf4a3c04fb7b41ae580d0e70a78
I20260811 00:50:47.958644 7092 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate dd72eaf4a3c04fb7b41ae580d0e70a78 for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 00:50:47.958819 7206 leader_election.cc:302] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd72eaf4a3c04fb7b41ae580d0e70a78; no voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd25cda1b02a432da0552de2e3f73206
I20260811 00:50:47.959910 7304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:47.960269 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:36603
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:43841
--webserver_port=35113
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:50:47.960850 7304 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 00:50:47.961783 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44508 (local address 127.26.99.188:36089)
0811 00:50:47.869797 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.869798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.870392 (+ 594us) server_negotiation.cc:407] Connection header received
0811 00:50:47.870500 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.870501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.870508 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.870543 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.893115 (+ 22572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.893780 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.894820 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.895108 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.895161 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.896149 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.896150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.896150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.896156 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.897575 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.959756 (+ 62181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.959758 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.959758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.959834 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.961137 (+ 1303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.961139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.961139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.961310 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.961412 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.961598 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.961696 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:50:47.962280 7343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.869588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44508)
0811 00:50:47.870342 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.870351 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.870433 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.871751 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.871751 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.892890 (+ 21139us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.892989 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.892995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.893875 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.893888 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.894727 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.894731 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.895252 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.895253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.895314 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.895671 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.895676 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.896072 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.955892 (+ 59820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.955893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.955893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.956151 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.960967 (+ 4816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.960969 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.960969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.961039 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.961440 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.961441 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.961487 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.962080 (+ 593us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.962191 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":63,"threads_started":1}
Aug 11 00:50:47 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409446, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.190@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
I20260811 00:50:47.969684 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.959428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44524)
0811 00:50:47.959520 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.959531 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.959569 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.961323 (+ 1754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.961325 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.961553 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.961612 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.961615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.962635 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.962636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.963472 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.963475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.964033 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.964035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.964114 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.964669 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.964676 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.966359 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.968522 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.968524 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.968525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.968742 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.968976 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.968977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.968977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.969049 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.969358 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.969360 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.969419 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.969465 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.969582 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 00:50:47.970146 7346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.959629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44524 (local address 127.26.99.188:36089)
0811 00:50:47.961183 (+ 1554us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.961185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.961190 (+ 5us) server_negotiation.cc:407] Connection header received
0811 00:50:47.961223 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.961224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.961235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.961691 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.961741 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.962532 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.963568 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.963924 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.966458 (+ 2534us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.966533 (+ 75us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.966534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.966535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.966539 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.968425 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.968853 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.968854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.968854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.968908 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.969128 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.969129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.969129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.969288 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.969883 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.969931 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.970021 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1533,"thread_start_us":89,"threads_started":1}
I20260811 00:50:47.970589 5918 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.99.188:36089: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
member_type: NON_VOTER
last_known_addr {
host: "127.26.99.188"
port: 36089
}
attrs {
promote: true
}
}
dest_uuid: "dd25cda1b02a432da0552de2e3f73206"
cas_config_opid_index: 5
I20260811 00:50:47.970849 5918 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } }
I20260811 00:50:47.971365 7005 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.972491 7005 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.99.188:36089
I20260811 00:50:47.972563 7005 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.972632 7005 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:47.972911 7177 master.cc:537] Master@127.26.99.188:36089 shutting down...
W20260811 00:50:47.973577 5901 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 -> Peer dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188:36089): Couldn't send request to peer dd72eaf4a3c04fb7b41ae580d0e70a78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 00:50:47.976464 7177 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:47.976547 7177 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:47.976590 7177 tablet_replica.cc:330] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: stopping tablet replica
I20260811 00:50:47.978070 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.971466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33778)
0811 00:50:47.971636 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.971645 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.971690 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.971847 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.971847 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.971994 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.972033 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.972034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.972967 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.972969 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.973674 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.973677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.974222 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.974223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.974281 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.974644 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:47.974649 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:47.975005 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:47.976834 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.976835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.976836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.977053 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.977246 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:47.977246 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:47.977247 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:47.977300 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:47.977763 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:47.977764 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:47.977810 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 00:50:47.977869 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:50:47.977979 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260811 00:50:47.978423 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.971567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.26.99.189:39221)
0811 00:50:47.971610 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.971611 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.971735 (+ 124us) server_negotiation.cc:407] Connection header received
0811 00:50:47.971759 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.971760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.971771 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.971808 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.972115 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.972875 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.973788 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.974108 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.974168 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:47.975104 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:47.975105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:47.975106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:47.975114 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:47.976744 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.977128 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.977129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.977129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.977185 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:47.977521 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:47.977522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:47.977522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:47.977673 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:47.977735 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:47.978252 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 00:50:47.978335 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:47.978657 7092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Refusing update from remote peer dd25cda1b02a432da0552de2e3f73206: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 00:50:47.980716 7350 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 00:50:47.981372 7092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.982836 7155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd25cda1b02a432da0552de2e3f73206. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.982956 7155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: LEARNER
I20260811 00:50:47.982997 7155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: NON_VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: true } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.983045 7155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: LEARNER
I20260811 00:50:47.985029 7002 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: attempting to promote NON_VOTER 0f0b4d7a572847ddb2ca6aa0545eadbf to VOTER
I20260811 00:50:47.985244 7002 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } }
I20260811 00:50:47.985846 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.985633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44526)
0811 00:50:47.985779 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.985821 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:36089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 00:50:47.986069 7092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 LEARNER]: Refusing update from remote peer dd25cda1b02a432da0552de2e3f73206: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 00:50:47.986321 7005 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 00:50:47.986568 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.986493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44532)
0811 00:50:47.986525 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.986547 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:36089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 00:50:47.986868 5901 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 -> Peer dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188:36089): Couldn't send request to peer dd72eaf4a3c04fb7b41ae580d0e70a78. Status: Network error: Client connection negotiation failed: client connection to 127.26.99.188:36089: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 00:50:47.987222 7005 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.987949 7092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.988174 7005 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.988255 7005 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:47.988309 7005 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.988372 7005 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:47.991542 7177 master.cc:552] Master@127.26.99.188:36089 shutdown complete.
I20260811 00:50:47.991592 7177 master_runner.cc:305] Clearing existing system tablet
I20260811 00:50:47.991710 7177 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:47.991755 7177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:47.992409 7177 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:47.993463 7356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:47.993566 7356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:50:47.993979 7360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:47.994122 7177 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:47.994169 7177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:47.994189 7177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "9f7f1455cd5703d38297aae0a494edd8"
server_key_iv: "911b138d418568166305e46bec34d430"
server_key_version: "encryptionkey@0"
I20260811 00:50:47.994963 7177 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:47.996639 7177 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 00:50:47.996706 7177 log.cc:1196] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 00:50:47.996905 7177 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Deleting consensus metadata
I20260811 00:50:47.997056 7177 master_runner.cc:315] Copying system tablet from 127.26.99.190:43841
I20260811 00:50:47.997676 7177 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: tablet copy: Beginning tablet copy session from remote peer at address 127.26.99.190:43841
I20260811 00:50:48.003610 7370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.998076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:49698)
0811 00:50:47.998230 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:47.998241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:47.998301 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:47.998417 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:47.998418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:47.998601 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:47.998650 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.998652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.999295 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:47.999296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:47.999964 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:47.999968 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.000367 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.000368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.000439 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.000900 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.000905 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.001252 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.002672 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.002673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.002673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.002836 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.003016 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.003017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.003017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.003073 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.003292 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.003293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.003339 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.003401 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.003513 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":69,"threads_started":1}
I20260811 00:50:48.003605 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:47.998137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49698 (local address 127.26.99.190:43841)
0811 00:50:47.998185 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:47.998187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:47.998300 (+ 113us) server_negotiation.cc:407] Connection header received
0811 00:50:47.998361 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:47.998362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:47.998372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:47.998413 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:47.998721 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:47.999224 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.000072 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.000281 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.000373 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.001331 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.001333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.001333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.001341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.002597 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.002896 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.002898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.002898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.002952 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.003123 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.003124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.003124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.003242 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.003298 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.003428 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.003508 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:50:48.003975 5955 tablet_copy_service.cc:140] P dd25cda1b02a432da0552de2e3f73206: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dd72eaf4a3c04fb7b41ae580d0e70a78 ({username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:49698)
I20260811 00:50:48.004057 5955 tablet_copy_service.cc:161] P dd25cda1b02a432da0552de2e3f73206: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dd72eaf4a3c04fb7b41ae580d0e70a78 at {username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:49698: session id = dd72eaf4a3c04fb7b41ae580d0e70a78-00000000000000000000000000000000
I20260811 00:50:48.004698 5955 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 00:50:48.005152 7177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 00:50:48.006228 7177 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: tablet copy: Starting download of 0 data blocks...
I20260811 00:50:48.006368 7177 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: tablet copy: Starting download of 1 WAL segments...
I20260811 00:50:48.007035 7177 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 00:50:48.007889 5955 tablet_copy_service.cc:342] P dd25cda1b02a432da0552de2e3f73206: Request end of tablet copy session dd72eaf4a3c04fb7b41ae580d0e70a78-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:49698
I20260811 00:50:48.007943 5955 tablet_copy_service.cc:433] P dd25cda1b02a432da0552de2e3f73206: ending tablet copy session dd72eaf4a3c04fb7b41ae580d0e70a78-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dd72eaf4a3c04fb7b41ae580d0e70a78
I20260811 00:50:48.010176 7177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:48.011243 7373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:48.011313 7376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:48.011437 7374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.011592 7177 server_base.cc:1034] running on GCE node
I20260811 00:50:48.011672 7177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:48.011809 7177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:48.012936 7177 hybrid_clock.cc:648] HybridClock initialized: now 1786409448012928 us; error 23 us; skew 500 ppm
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:48.014271 7177 init.cc:377] Logged in from keytab as oryx/127.26.99.188@KRBTEST.COM (short username oryx)
I20260811 00:50:48.014510 7177 webserver.cc:460] Webserver started at http://127.26.99.188:35677/ using document root <none> and password file <none>
I20260811 00:50:48.014622 7177 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:48.014655 7177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:48.015225 7177 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.015741 7390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.015837 7177 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.015873 7177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "9f7f1455cd5703d38297aae0a494edd8"
server_key_iv: "911b138d418568166305e46bec34d430"
server_key_version: "encryptionkey@0"
I20260811 00:50:48.015933 7177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:48.026116 7177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:48.027624 7177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:48.030534 7177 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.188:36089
I20260811 00:50:48.030560 7497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.188:36089 every 8 connection(s)
I20260811 00:50:48.030859 7177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
I20260811 00:50:48.032990 7502 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:50:48.033399 7502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Bootstrap starting.
I20260811 00:50:48.035604 7502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:50:48.035796 7502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Bootstrap complete.
I20260811 00:50:48.035995 7502 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } }
I20260811 00:50:48.036072 7502 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dd72eaf4a3c04fb7b41ae580d0e70a78, State: Initialized, Role: LEARNER
I20260811 00:50:48.036110 7502 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } }
I20260811 00:50:48.036314 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:48.036305 7502 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:48.036527 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: LEARNER
I20260811 00:50:48.038033 7525 catalog_manager.cc:1259] Loaded cluster ID: 5492a805cd6f4399828c34963da2a0e1
I20260811 00:50:48.038131 7525 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: loading cluster ID for follower catalog manager: success
I20260811 00:50:48.039100 7525 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: acquiring CA information for follower catalog manager: success
I20260811 00:50:48.039371 7525 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 00:50:48.083204 7348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:48.083410 7348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:48.083434 7348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:48.084553 7348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:48.084595 7348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:48.084620 7348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:48.086087 7348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:36603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=35113
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:48.086288 7348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:48.086472 7348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:48.091413 7537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:48.091419 7541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.091454 7348 server_base.cc:1034] running on GCE node
W20260811 00:50:48.091424 7536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.091835 7348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:48.092077 7348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:48.093225 7348 hybrid_clock.cc:648] HybridClock initialized: now 1786409448093206 us; error 30 us; skew 500 ppm
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:48.095800 7348 init.cc:377] Logged in from keytab as oryx/127.26.99.129@KRBTEST.COM (short username oryx)
I20260811 00:50:48.096235 7348 webserver.cc:460] Webserver started at http://127.26.99.129:35113/ using document root <none> and password file <none>
I20260811 00:50:48.096481 7348 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:48.096551 7348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:48.097996 7348 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:48.098591 7554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.098758 7348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:48.098850 7348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "d9638f71383a48bc90e230436eb7c5be"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "82166094f76bb12ce5ab7607f9ccaceb"
server_key_iv: "1f7f0510b5f8b576e07207ee2cc22d23"
server_key_version: "encryptionkey@0"
I20260811 00:50:48.099258 7348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:48.109938 7348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:48.111955 7348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:48.112089 7348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:48.112286 7348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:48.112602 7348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:48.112635 7348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.112663 7348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:48.112687 7348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.119035 7348 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36603
I20260811 00:50:48.119097 7750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36603 every 8 connection(s)
I20260811 00:50:48.119421 7348 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:48.128364 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 7348
I20260811 00:50:48.128511 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 6300
I20260811 00:50:48.129789 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.26.99.129:34049)
0811 00:50:48.120260 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.120300 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.120921 (+ 621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.121235 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.121236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.121577 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.121810 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.121814 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122942 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.122943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.123694 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.123697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124517 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.124661 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.124961 (+ 300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.124964 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.126428 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.128468 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.128475 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.128478 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.128745 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.128934 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.128934 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.128935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.129039 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.129260 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.129265 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.129405 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.129486 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.129618 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":32,"thread_start_us":88,"threads_started":1}
I20260811 00:50:48.130131 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:34049 (local address 127.26.99.188:36089)
0811 00:50:48.120536 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.120538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.120549 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:48.121102 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.121103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.121115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.121190 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.121904 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122876 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124203 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124451 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124508 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.126514 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.126515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.126515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.126522 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.128329 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.128817 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.128818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.128818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.128876 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.129091 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.129092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.129092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.129198 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.129242 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.129979 (+ 737us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.130056 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":51,"threads_started":1}
I20260811 00:50:48.130427 7752 heartbeater.cc:347] Connected to a master server at 127.26.99.188:36089
I20260811 00:50:48.130499 7752 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.130650 7752 heartbeater.cc:511] Master 127.26.99.188:36089 requested a full tablet report, sending...
I20260811 00:50:48.131158 7423 ts_manager.cc:194] Registered new tserver with Master: d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:48.132659 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:39761 (local address 127.26.99.190:43841)
0811 00:50:48.120662 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.120663 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.120672 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:48.121043 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.121044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.121057 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.121086 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.121930 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122695 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.123791 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124080 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124145 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.126961 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.126963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.126963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.126970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.128555 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.131679 (+ 3124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.131681 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.131681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.131752 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.131986 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.131987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.131987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.132130 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.132180 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.132454 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.132544 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:48.132980 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:39761)
0811 00:50:48.120556 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.120565 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.120935 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.121570 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.121571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.121711 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.121810 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.121816 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122812 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.122813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.123684 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.123686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124159 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.124303 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.125084 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.125089 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.126876 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.128650 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.128651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.128652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.131561 (+ 2909us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.131836 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.131837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.131837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.131906 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.132234 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.132234 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.132283 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.132759 (+ 476us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.132869 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":7,"thread_start_us":69,"threads_started":1}
I20260811 00:50:48.145335 7755 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:48.145406 7755 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.145489 7755 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:48.145825 5918 ts_manager.cc:194] Re-registered known tserver with Master: d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:48.146309 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:39761
I20260811 00:50:48.146430 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:48537 (local address 127.26.99.189:39221)
0811 00:50:48.120360 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.120362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.120436 (+ 74us) server_negotiation.cc:407] Connection header received
0811 00:50:48.121053 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.121054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.121067 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.121132 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.121932 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122425 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.123775 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124080 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124145 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.127407 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.127408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.127408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.127416 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.145168 (+ 17752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.145617 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.145618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.145618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.145682 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.145894 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.145895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.145896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.146040 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.146111 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.146254 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.146348 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260811 00:50:48.147953 7765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.120102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.26.99.129:48537)
0811 00:50:48.120360 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.120370 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.120942 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.121229 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.121234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.121576 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.121810 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.121816 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.122507 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.122507 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.123702 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.123704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.124161 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.124161 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.124303 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.124849 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.124859 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.127296 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.145265 (+ 17969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.145267 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.145268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.145547 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.145739 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.145740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.145740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.145821 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.146107 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.146108 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.146160 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.146225 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.146336 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":56,"thread_start_us":93,"threads_started":1}
I20260811 00:50:48.148427 7762 heartbeater.cc:347] Connected to a master server at 127.26.99.189:39221
I20260811 00:50:48.148478 7762 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.148561 7762 heartbeater.cc:511] Master 127.26.99.189:39221 requested a full tablet report, sending...
I20260811 00:50:48.148969 7070 ts_manager.cc:194] Registered new tserver with Master: d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:48.149437 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:35833
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:43841
--webserver_port=46661
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:48.231659 7769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:48.231854 7769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:48.231876 7769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:48.233075 7769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:48.233112 7769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:48.233137 7769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:48.234620 7769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:35833
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=46661
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:48.234800 7769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:48.234977 7769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:48.239756 7782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:48.239776 7777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.239809 7769 server_base.cc:1034] running on GCE node
W20260811 00:50:48.239769 7780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.240232 7769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:48.240491 7769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:48.241636 7769 hybrid_clock.cc:648] HybridClock initialized: now 1786409448241624 us; error 29 us; skew 500 ppm
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:48.243917 7769 init.cc:377] Logged in from keytab as oryx/127.26.99.130@KRBTEST.COM (short username oryx)
I20260811 00:50:48.244379 7769 webserver.cc:460] Webserver started at http://127.26.99.130:46661/ using document root <none> and password file <none>
I20260811 00:50:48.244596 7769 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:48.244655 7769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:48.245918 7769 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:48.246430 7798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.246575 7769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:48.246663 7769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "1760bf948aed407d91dde79eba1cf0bc"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "7d52e8cdca7a00390889428f15403d6e"
server_key_iv: "cd7b5197b43aafab1b9e5d932a835af9"
server_key_version: "encryptionkey@0"
I20260811 00:50:48.246990 7769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:48.266526 7769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:48.268740 7769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:48.268857 7769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:48.269059 7769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:48.269377 7769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:48.269412 7769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.269436 7769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:48.269459 7769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.275301 7769 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:35833
I20260811 00:50:48.275369 8030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:35833 every 8 connection(s)
I20260811 00:50:48.275766 7769 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:48.284807 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 7769
I20260811 00:50:48.284970 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 6562
I20260811 00:50:48.286686 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:43045 (local address 127.26.99.190:43841)
0811 00:50:48.276838 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.276840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.276850 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:48.277362 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.277364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.277376 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.277426 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.278335 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.278828 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.279936 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.280268 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280310 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.283464 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.283465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.283466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.283474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.284868 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.285356 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.285357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.285357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.285419 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.285748 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.285749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.285749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.285912 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.285966 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.286479 (+ 513us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.286577 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:50:48.287310 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:43045)
0811 00:50:48.276681 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.276718 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.277265 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.277526 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.277530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.277914 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.278234 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.278236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.278900 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.278901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.279836 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.279837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.280427 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.280503 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.281001 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.281006 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.283392 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.284961 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.284970 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.284972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.285270 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.285496 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.285497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.285498 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.285657 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.286020 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.286028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.286261 (+ 233us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.286793 (+ 532us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.287011 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":33,"thread_start_us":92,"threads_started":1}
I20260811 00:50:48.288975 8036 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:48.289086 8036 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.289304 8036 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:48.289721 8044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.26.99.130:45347)
0811 00:50:48.276945 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.276956 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.277272 (+ 316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.277526 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.277536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.277963 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.278203 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.278209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.278890 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.278891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.279842 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.279845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.280219 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.280373 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.280876 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.280884 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.283004 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.285076 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.285077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.285078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.288803 (+ 3725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.289026 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.289026 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.289027 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.289095 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.289390 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.289391 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.289431 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.289513 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.289616 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":33,"thread_start_us":83,"threads_started":1}
I20260811 00:50:48.289722 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:45347 (local address 127.26.99.188:36089)
0811 00:50:48.276560 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.276562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.277013 (+ 451us) server_negotiation.cc:407] Connection header received
0811 00:50:48.277378 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.277379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.277405 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.277454 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.278283 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.278789 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.279914 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.280152 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280207 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.283110 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.283112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.283112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.283121 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.284980 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.288889 (+ 3909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.288890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.288890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.288953 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.289168 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.289169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.289170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.289298 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.289343 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.289553 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.289638 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:50:48.289721 5918 ts_manager.cc:194] Re-registered known tserver with Master: 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833)
I20260811 00:50:48.290002 8032 heartbeater.cc:347] Connected to a master server at 127.26.99.188:36089
I20260811 00:50:48.290045 8032 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.290095 8032 heartbeater.cc:511] Master 127.26.99.188:36089 requested a full tablet report, sending...
I20260811 00:50:48.290207 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:43045
I20260811 00:50:48.290365 7423 ts_manager.cc:194] Registered new tserver with Master: 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833)
I20260811 00:50:48.294503 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37393 (local address 127.26.99.189:39221)
0811 00:50:48.277069 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.277070 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.277493 (+ 423us) server_negotiation.cc:407] Connection header received
0811 00:50:48.277585 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.277586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.277599 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.277653 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.278886 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.279601 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280633 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.280920 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.280985 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.283704 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.283705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.283705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.283713 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.293454 (+ 9741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.293800 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.293801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.293802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.293876 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.294026 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.294026 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.294027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.294168 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.294229 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.294368 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.294440 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 00:50:48.294636 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:39907
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:43841
--webserver_port=41555
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:50:48.294726 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.276808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.26.99.130:37393)
0811 00:50:48.277439 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.277449 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.277516 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.277682 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.277682 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.277900 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.278203 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.278208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.279689 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.279690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.280528 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.280529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.281041 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.281043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.281094 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.281438 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.281445 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.283383 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.293561 (+ 10178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.293562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.293562 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.293724 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.293937 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.293937 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.293937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.293979 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.294226 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.294227 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.294262 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.294329 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.294441 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":10,"thread_start_us":55,"threads_started":1}
I20260811 00:50:48.295054 8037 heartbeater.cc:347] Connected to a master server at 127.26.99.189:39221
I20260811 00:50:48.295107 8037 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.295195 8037 heartbeater.cc:511] Master 127.26.99.189:39221 requested a full tablet report, sending...
I20260811 00:50:48.295500 7070 ts_manager.cc:194] Registered new tserver with Master: 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833)
W20260811 00:50:48.378228 8047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:48.378441 8047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:48.378464 8047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:48.379637 8047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:48.379678 8047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:48.379703 8047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:48.381292 8047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:39907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=41555
--tserver_master_addrs=127.26.99.190:43841,127.26.99.189:39221,127.26.99.188:36089
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:48.381521 8047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:48.381765 8047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:48.386796 8060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.386847 8047 server_base.cc:1034] running on GCE node
W20260811 00:50:48.386821 8055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:48.386811 8057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:48.387185 8047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:48.387410 8047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:48.388546 8047 hybrid_clock.cc:648] HybridClock initialized: now 1786409448388530 us; error 31 us; skew 500 ppm
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:48.390966 8047 init.cc:377] Logged in from keytab as oryx/127.26.99.131@KRBTEST.COM (short username oryx)
I20260811 00:50:48.391367 8047 webserver.cc:460] Webserver started at http://127.26.99.131:41555/ using document root <none> and password file <none>
I20260811 00:50:48.391544 8047 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:48.391595 8047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:48.392931 8047 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:48.393445 8078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.393579 8047 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.393663 8047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
format_stamp: "Formatted at 2026-08-11 00:50:47 on dist-test-slave-xt4k"
server_key: "a6fe31fb3caa22fd57d1e2a91d52a84e"
server_key_iv: "a15ff84a031893793fdd86b80dc49935"
server_key_version: "encryptionkey@0"
I20260811 00:50:48.394006 8047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:48.412075 8047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:48.414013 8047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:48.414150 8047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:48.414399 8047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:48.414703 8047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:48.414739 8047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.414762 8047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:48.414772 8047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:48.420523 8047 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39907
I20260811 00:50:48.420603 8294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39907 every 8 connection(s)
I20260811 00:50:48.420953 8047 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.188@KRBTEST.COM
Aug 11 00:50:48 dist-test-slave-xt4k krb5kdc[5841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409448, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.189@KRBTEST.COM
I20260811 00:50:48.429903 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 8047
I20260811 00:50:48.431034 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.421630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:57689 (local address 127.26.99.190:43841)
0811 00:50:48.421680 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.421682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.421992 (+ 310us) server_negotiation.cc:407] Connection header received
0811 00:50:48.422621 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.422622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.422635 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.422667 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.423550 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424269 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425694 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.425939 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425998 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.428084 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.428085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.428086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.428093 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.429666 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430071 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.430072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.430072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.430139 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430357 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.430358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.430358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.430486 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.430548 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.430870 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.430947 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:50:48.431219 8300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.421640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:57689)
0811 00:50:48.421828 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.421871 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.422501 (+ 630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.422751 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.422756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.423226 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.423447 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.423453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424463 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.424464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.425585 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.425587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.426051 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.426051 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.426110 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.426604 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.426608 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.427997 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.429772 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.429780 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.429782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.429998 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.430195 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.430196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.430302 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.430573 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.430579 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.430736 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.430841 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.430996 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":86,"thread_start_us":92,"threads_started":1}
I20260811 00:50:48.431531 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.421666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.26.99.131:42591)
0811 00:50:48.421829 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.421871 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.422503 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.423012 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.423013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.423255 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.423446 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.423450 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424420 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.424422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.425434 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.425437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.425847 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.425980 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.426426 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.426435 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.428599 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.430476 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.430477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.430675 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.430893 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.430895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.430960 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.431218 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.431219 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.431264 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.431336 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.431432 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":46,"thread_start_us":91,"threads_started":1}
I20260811 00:50:48.431531 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.421921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:42591 (local address 127.26.99.188:36089)
0811 00:50:48.421970 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.421972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.422008 (+ 36us) server_negotiation.cc:407] Connection header received
0811 00:50:48.422599 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.422600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.422612 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.422669 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.423535 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424301 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425528 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.425773 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425835 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.428728 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.428730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.428730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.428739 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.430360 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.430748 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.430749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.430749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.430813 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.431030 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.431031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.431031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.431155 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.431220 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.431373 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.431446 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:50:48.432024 8295 heartbeater.cc:347] Connected to a master server at 127.26.99.188:36089
I20260811 00:50:48.432129 8295 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.432200 8296 heartbeater.cc:347] Connected to a master server at 127.26.99.190:43841
I20260811 00:50:48.432248 8296 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.432310 8295 heartbeater.cc:511] Master 127.26.99.188:36089 requested a full tablet report, sending...
I20260811 00:50:48.432312 8296 heartbeater.cc:511] Master 127.26.99.190:43841 requested a full tablet report, sending...
I20260811 00:50:48.432814 5918 ts_manager.cc:194] Re-registered known tserver with Master: 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:48.432875 7423 ts_manager.cc:194] Registered new tserver with Master: 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:48.433283 5918 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:57689
I20260811 00:50:48.433662 8302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.422014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.26.99.131:37885)
0811 00:50:48.422131 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.422138 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.422514 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.422754 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.422757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.423222 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:48.423447 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.423453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424765 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.424766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.425585 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.425587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.426007 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.426009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.426083 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.426649 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:48.426654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:48.428859 (+ 2205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:48.432216 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.432217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.432217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.432436 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.432656 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:48.432657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:48.432657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:48.432712 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:48.433213 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:48.433213 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:48.433254 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.433312 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.433405 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":5,"thread_start_us":66,"threads_started":1}
I20260811 00:50:48.433940 7153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.422210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:37885 (local address 127.26.99.189:39221)
0811 00:50:48.422277 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.422279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.422289 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:48.422628 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.422630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.422641 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.422671 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.423560 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.424291 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425680 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.425936 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.425991 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.428959 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.428960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.428960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.428967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.431422 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.432525 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.432527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.432527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.432587 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.432971 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.432973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.432973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.433113 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.433185 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.433773 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.433852 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:50:48.434760 8297 heartbeater.cc:347] Connected to a master server at 127.26.99.189:39221
I20260811 00:50:48.434816 8297 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:48.434886 8297 heartbeater.cc:511] Master 127.26.99.189:39221 requested a full tablet report, sending...
I20260811 00:50:48.435165 7070 ts_manager.cc:194] Registered new tserver with Master: 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:48.439954 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.432110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33792 (local address 127.26.99.189:39221)
0811 00:50:48.432227 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.432229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.432929 (+ 700us) server_negotiation.cc:407] Connection header received
0811 00:50:48.432949 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.432950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.432962 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.433012 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.433570 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.434288 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.435239 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.435545 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.435602 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.437006 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.437007 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.437007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.437014 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.438424 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.438800 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.438801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.438802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.438867 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.439080 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.439081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.439082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.439381 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.439483 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.439778 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.439858 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260811 00:50:48.441066 5997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.431685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49708 (local address 127.26.99.190:43841)
0811 00:50:48.431751 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.431753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.432566 (+ 813us) server_negotiation.cc:407] Connection header received
0811 00:50:48.432627 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.432628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.432638 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.432688 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.433533 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.434263 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.436454 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.436698 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.436754 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.438079 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.438081 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.438081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.438089 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.439610 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.440301 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.440302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.440303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.440380 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.440579 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.440580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.440581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.440696 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.440769 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.440909 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.440980 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:50:48.441810 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.434521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.26.99.188:36089)
0811 00:50:48.434555 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.434557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.434875 (+ 318us) server_negotiation.cc:407] Connection header received
0811 00:50:48.434958 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.434959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.434969 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.434993 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.435709 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.436285 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.437293 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.437579 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.437649 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.439198 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.439199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.439200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.439206 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.440762 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.441124 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.441125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.441125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.441189 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.441369 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.441370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.441370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.441466 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.441528 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.441654 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.441726 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:48.442713 5918 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:48.444278 5918 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:48.452046 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.447932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:35833 (local address 127.0.0.1:37516)
0811 00:50:48.447978 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.447987 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.448023 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.448870 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.448871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.448872 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.448913 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.448914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.450110 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.450112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.451003 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.451006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.451783 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.451784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.451846 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.451869 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.451931 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.451974 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 00:50:48.452065 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.448046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37516 (local address 127.26.99.130:35833)
0811 00:50:48.448737 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.448741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.448748 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:48.448777 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.448779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.448791 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.448854 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.448997 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.450040 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.451073 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.451708 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.451773 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.451855 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.451948 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.451991 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":85,"threads_started":1}
I20260811 00:50:48.452310 8327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.447953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39907 (local address 127.0.0.1:33860)
0811 00:50:48.448128 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.448137 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.448176 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.448535 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.448536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.448538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.448601 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.448602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.449912 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.449913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.451108 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.451111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.452059 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.452061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.452148 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.452154 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.452184 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.452226 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":30,"thread_start_us":79,"threads_started":1}
I20260811 00:50:48.452692 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.447993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36603 (local address 127.0.0.1:57778)
0811 00:50:48.448243 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.448254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.448304 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.448925 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.448926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.448928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.448973 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.448974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.449853 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.449854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.451118 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.451120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.452459 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.452461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.452524 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.452528 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.452574 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.452617 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":28,"thread_start_us":96,"threads_started":1}
I20260811 00:50:48.452757 8329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.448179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33860 (local address 127.26.99.131:39907)
0811 00:50:48.448359 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.448364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.448374 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:48.448415 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.448418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.448436 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.448520 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.448664 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.449812 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.451215 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.451971 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.452526 (+ 555us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.452614 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.452640 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.452685 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260811 00:50:48.452970 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.448241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57778 (local address 127.26.99.129:36603)
0811 00:50:48.448472 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.448475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.448484 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:48.448521 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.448522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.448536 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.448603 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.449030 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.449779 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.451215 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.451957 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.452029 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.452422 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.452859 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.452907 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":121,"threads_started":1}
I20260811 00:50:48.453110 7898 tablet_service.cc:1467] Processing CreateTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 (DEFAULT_TABLE table=test-table [id=97bc0f4260cc4407b98de471faf504ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:48.453518 7898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f94d601767455aaff1bd0212ff8ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:48.453662 7634 tablet_service.cc:1467] Processing CreateTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 (DEFAULT_TABLE table=test-table [id=97bc0f4260cc4407b98de471faf504ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:48.453996 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f94d601767455aaff1bd0212ff8ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:48.457278 8333 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Bootstrap starting.
I20260811 00:50:48.457669 8338 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Bootstrap starting.
I20260811 00:50:48.458007 8333 tablet_bootstrap.cc:654] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:48.457981 8168 tablet_service.cc:1467] Processing CreateTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 (DEFAULT_TABLE table=test-table [id=97bc0f4260cc4407b98de471faf504ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:48.458166 8338 tablet_bootstrap.cc:654] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:48.458353 8168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04f94d601767455aaff1bd0212ff8ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:48.458365 8333 log.cc:824] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:48.458436 8338 log.cc:824] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:48.459219 8338 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: No bootstrap required, opened a new log
I20260811 00:50:48.459281 8338 ts_tablet_manager.cc:1397] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:48.461325 8338 raft_consensus.cc:348] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.461506 8338 raft_consensus.cc:374] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:48.461547 8338 raft_consensus.cc:729] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9638f71383a48bc90e230436eb7c5be, State: Initialized, Role: FOLLOWER
I20260811 00:50:48.461683 8338 consensus_queue.cc:260] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.461941 8338 ts_tablet_manager.cc:1428] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:48.462095 7755 heartbeater.cc:503] Master 127.26.99.190:43841 was elected leader, sending a full tablet report...
I20260811 00:50:48.462253 8341 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Bootstrap starting.
I20260811 00:50:48.462649 8333 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: No bootstrap required, opened a new log
I20260811 00:50:48.462731 8333 ts_tablet_manager.cc:1397] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 00:50:48.463232 8341 tablet_bootstrap.cc:654] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:48.463567 8341 log.cc:824] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:48.464227 8341 tablet_bootstrap.cc:492] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: No bootstrap required, opened a new log
I20260811 00:50:48.464286 8341 ts_tablet_manager.cc:1397] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:48.465145 8333 raft_consensus.cc:348] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.465272 8333 raft_consensus.cc:374] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:48.465293 8333 raft_consensus.cc:729] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1760bf948aed407d91dde79eba1cf0bc, State: Initialized, Role: FOLLOWER
I20260811 00:50:48.465387 8333 consensus_queue.cc:260] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.465631 8333 ts_tablet_manager.cc:1428] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:48.465740 8036 heartbeater.cc:503] Master 127.26.99.190:43841 was elected leader, sending a full tablet report...
I20260811 00:50:48.466814 8341 raft_consensus.cc:348] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.466958 8341 raft_consensus.cc:374] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:48.467003 8341 raft_consensus.cc:729] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2a8ec0b4654884b6dbeb5d6976e286, State: Initialized, Role: FOLLOWER
I20260811 00:50:48.467129 8341 consensus_queue.cc:260] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.467381 8341 ts_tablet_manager.cc:1428] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:50:48.467417 8296 heartbeater.cc:503] Master 127.26.99.190:43841 was elected leader, sending a full tablet report...
I20260811 00:50:48.490927 8326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.488446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44558)
0811 00:50:48.488514 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.488526 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.488580 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.488798 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.488799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.488801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.488852 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.488854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.489474 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.489476 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.490189 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.490191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.490761 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.490761 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.490803 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.490806 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.490833 (+ 27us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.490869 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 00:50:48.490919 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.488525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44558 (local address 127.26.99.188:36089)
0811 00:50:48.488576 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.488579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.488590 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:48.488684 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.488685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.488716 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.488784 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.488904 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.489393 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.490277 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.490685 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.490756 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.490817 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.490836 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.490862 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:48.491374 7441 raft_consensus.cc:1203] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 00:50:48.492277 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd25cda1b02a432da0552de2e3f73206. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:48.492417 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: LEARNER
W20260811 00:50:48.526537 8039 tablet.cc:2369] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:48.582489 8343 raft_consensus.cc:482] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:48.582635 8343 raft_consensus.cc:504] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.582996 8343 leader_election.cc:288] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833), 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:48.585721 7768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.583187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39907 (local address 127.26.99.129:57755)
0811 00:50:48.583288 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.583301 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.583347 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.583481 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.583483 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.583484 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.583554 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.583555 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.584162 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.584163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.584953 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.584956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.585468 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.585554 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.585557 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.585603 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.585644 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 00:50:48.585721 8329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.583290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:57755 (local address 127.26.99.131:39907)
0811 00:50:48.583347 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.583349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.583361 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:50:48.583396 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.583397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.583406 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.583460 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.583615 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.584094 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585036 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.585401 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585465 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.585474 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.585618 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.585662 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:50:48.585871 7765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.583221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:35833 (local address 127.26.99.129:48687)
0811 00:50:48.583372 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:48.583381 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:48.583415 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:48.583546 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:48.583547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:48.583548 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:48.583617 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.583619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.584244 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.584245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.585012 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:48.585014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.585610 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:48.585692 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.585696 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:48.585740 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:48.585782 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260811 00:50:48.585866 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.583321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:48687 (local address 127.26.99.130:35833)
0811 00:50:48.583431 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.583433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.583450 (+ 17us) server_negotiation.cc:407] Connection header received
0811 00:50:48.583477 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.583478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.583486 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.583529 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:48.583679 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.584171 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585100 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.585532 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.585597 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.585606 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.585760 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.585805 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 00:50:48.586087 8210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f94d601767455aaff1bd0212ff8ed0" candidate_uuid: "d9638f71383a48bc90e230436eb7c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" is_pre_election: true
I20260811 00:50:48.586185 7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f94d601767455aaff1bd0212ff8ed0" candidate_uuid: "d9638f71383a48bc90e230436eb7c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1760bf948aed407d91dde79eba1cf0bc" is_pre_election: true
I20260811 00:50:48.586256 8210 raft_consensus.cc:2454] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9638f71383a48bc90e230436eb7c5be in term 0.
I20260811 00:50:48.586320 7937 raft_consensus.cc:2454] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9638f71383a48bc90e230436eb7c5be in term 0.
I20260811 00:50:48.586488 7558 leader_election.cc:302] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c2a8ec0b4654884b6dbeb5d6976e286, d9638f71383a48bc90e230436eb7c5be; no voters:
I20260811 00:50:48.586615 8343 raft_consensus.cc:2781] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:48.586673 8343 raft_consensus.cc:482] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:48.586700 8343 raft_consensus.cc:3037] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:48.587409 8343 raft_consensus.cc:504] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.587540 8343 leader_election.cc:288] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [CANDIDATE]: Term 1 election: Requested vote from peers 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833), 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907)
I20260811 00:50:48.587687 7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f94d601767455aaff1bd0212ff8ed0" candidate_uuid: "d9638f71383a48bc90e230436eb7c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1760bf948aed407d91dde79eba1cf0bc"
I20260811 00:50:48.587756 8210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04f94d601767455aaff1bd0212ff8ed0" candidate_uuid: "d9638f71383a48bc90e230436eb7c5be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
I20260811 00:50:48.587770 7937 raft_consensus.cc:3037] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:48.587832 8210 raft_consensus.cc:3037] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:48.588611 7937 raft_consensus.cc:2454] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9638f71383a48bc90e230436eb7c5be in term 1.
I20260811 00:50:48.588660 8210 raft_consensus.cc:2454] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9638f71383a48bc90e230436eb7c5be in term 1.
I20260811 00:50:48.588790 7556 leader_election.cc:302] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1760bf948aed407d91dde79eba1cf0bc, d9638f71383a48bc90e230436eb7c5be; no voters:
I20260811 00:50:48.588900 8343 raft_consensus.cc:2781] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:48.589043 8343 raft_consensus.cc:686] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 1 LEADER]: Becoming Leader. State: Replica: d9638f71383a48bc90e230436eb7c5be, State: Running, Role: LEADER
I20260811 00:50:48.589140 8343 consensus_queue.cc:237] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } }
I20260811 00:50:48.590004 5918 catalog_manager.cc:5495] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be reported cstate change: term changed from 0 to 1, leader changed from <none> to d9638f71383a48bc90e230436eb7c5be (127.26.99.129). New cstate: current_term: 1 leader_uuid: "d9638f71383a48bc90e230436eb7c5be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:48.590612 7350 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: NON_VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: true } } }
I20260811 00:50:48.590703 7350 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:48.591516 8362 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: attempting to promote NON_VOTER dd72eaf4a3c04fb7b41ae580d0e70a78 to VOTER
I20260811 00:50:48.591693 8362 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:48.592108 7441 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 LEARNER]: Refusing update from remote peer dd25cda1b02a432da0552de2e3f73206: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 00:50:48.592113 7092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Refusing update from remote peer dd25cda1b02a432da0552de2e3f73206: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 00:50:48.592324 8361 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 00:50:48.592490 7357 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 00:50:48.592945 8361 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.593081 7441 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.593713 8361 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.593789 8361 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:48.593760 7357 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.593814 7357 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:48.593890 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.593976 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:50:48.594061 8362 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.594134 8362 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:48.594096 7092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.594832 8366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd25cda1b02a432da0552de2e3f73206" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:48.594915 8366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:50:48.598788 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.596650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57788 (local address 127.26.99.129:36603)
0811 00:50:48.596687 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.596689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.596696 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:48.596750 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.596751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.596766 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.596823 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:48.596897 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.597377 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.598155 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.598331 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.598375 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.598554 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:48.598645 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:48.598709 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.598724 (+ 15us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.598742 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:48.600477 7937 raft_consensus.cc:1261] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Refusing update from remote peer d9638f71383a48bc90e230436eb7c5be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:48.600525 8210 raft_consensus.cc:1261] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Refusing update from remote peer d9638f71383a48bc90e230436eb7c5be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:48.600849 8358 consensus_queue.cc:1035] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:48.600965 8343 consensus_queue.cc:1035] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:48.603473 8368 mvcc.cc:205] Tried to move back new op lower bound from 7317133101464403968 to 7317133101421608960. Current Snapshot: MvccSnapshot[applied={T|T < 7317133101464403968}]
I20260811 00:50:48.603623 8369 mvcc.cc:205] Tried to move back new op lower bound from 7317133101464403968 to 7317133101421608960. Current Snapshot: MvccSnapshot[applied={T|T < 7317133101464403968}]
I20260811 00:50:48.605545 8370 mvcc.cc:205] Tried to move back new op lower bound from 7317133101464403968 to 7317133101421608960. Current Snapshot: MvccSnapshot[applied={T|T < 7317133101464403968 or (T in {7317133101464403968})}]
I20260811 00:50:48.607373 5918 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:48.607450 5918 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:48.608642 5918 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd25cda1b02a432da0552de2e3f73206: Sending DeleteTablet for 3 replicas of tablet 04f94d601767455aaff1bd0212ff8ed0
I20260811 00:50:48.608954 7634 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:48 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:57778
I20260811 00:50:48.608961 8168 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:48 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:33860
I20260811 00:50:48.608978 7898 tablet_service.cc:1514] Processing DeleteTablet for tablet 04f94d601767455aaff1bd0212ff8ed0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:48 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:37516
I20260811 00:50:48.610014 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 5863
I20260811 00:50:48.629287 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.609462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44566 (local address 127.26.99.188:36089)
0811 00:50:48.609515 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.609516 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.609526 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:48.609554 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.609555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.609565 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.609620 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.622475 (+ 12855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.623074 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.624350 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.624584 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.624639 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.626606 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.626607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.626607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.626615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.628030 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.628436 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.628436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.628437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.628504 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.628687 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.628688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.628688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.628858 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.628976 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.629052 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.629147 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:50:48.632568 8389 tablet_replica.cc:330] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: stopping tablet replica
I20260811 00:50:48.632833 8389 raft_consensus.cc:2229] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:48.632984 8386 tablet_replica.cc:330] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: stopping tablet replica
I20260811 00:50:48.633018 8389 raft_consensus.cc:2258] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:48.633179 8386 raft_consensus.cc:2229] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:48.633373 8386 raft_consensus.cc:2258] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:48.633647 8389 ts_tablet_manager.cc:1905] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:48.633956 8386 ts_tablet_manager.cc:1905] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:48.635466 8389 ts_tablet_manager.cc:1918] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:48.635552 8389 log.cc:1196] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/04f94d601767455aaff1bd0212ff8ed0
I20260811 00:50:48.635728 8386 ts_tablet_manager.cc:1918] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:48.635815 8389 ts_tablet_manager.cc:1939] T 04f94d601767455aaff1bd0212ff8ed0 P 1760bf948aed407d91dde79eba1cf0bc: Deleting consensus metadata
I20260811 00:50:48.635937 8386 log.cc:1196] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/04f94d601767455aaff1bd0212ff8ed0
I20260811 00:50:48.636241 8386 ts_tablet_manager.cc:1939] T 04f94d601767455aaff1bd0212ff8ed0 P d9638f71383a48bc90e230436eb7c5be: Deleting consensus metadata
I20260811 00:50:48.636480 8391 tablet_replica.cc:330] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: stopping tablet replica
I20260811 00:50:48.636652 8391 raft_consensus.cc:2229] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:48.636834 8391 raft_consensus.cc:2258] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:48.637264 8391 ts_tablet_manager.cc:1905] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 00:50:48.637873 7558 connection.cc:535] server connection from 127.0.0.1:57778 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 00:50:48.638059 7799 connection.cc:535] server connection from 127.0.0.1:37516 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:50:48.639151 8391 ts_tablet_manager.cc:1918] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:48.639225 8391 log.cc:1196] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/04f94d601767455aaff1bd0212ff8ed0
I20260811 00:50:48.639488 8391 ts_tablet_manager.cc:1939] T 04f94d601767455aaff1bd0212ff8ed0 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting consensus metadata
W20260811 00:50:48.639827 8079 connection.cc:441] server connection from 127.0.0.1:33860 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33860 (request call id 1) could send its response
I20260811 00:50:48.647418 7767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.639555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44574 (local address 127.26.99.188:36089)
0811 00:50:48.639601 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.639603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.639965 (+ 362us) server_negotiation.cc:407] Connection header received
0811 00:50:48.640064 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.640065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.640076 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.640139 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.641848 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.642603 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.643349 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.643614 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.643646 (+ 32us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.644855 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.644856 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.644856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.644863 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.646200 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.646638 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.646640 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.646640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.646694 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.646907 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.646908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.646908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.647012 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.647069 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.647251 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.647316 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:48.647418 8311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:48.639765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33800 (local address 127.26.99.189:39221)
0811 00:50:48.639817 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:48.639820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:48.640015 (+ 195us) server_negotiation.cc:407] Connection header received
0811 00:50:48.640113 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:48.640114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:48.640131 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:48.640175 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:48.640967 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.641743 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.642887 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:48.643230 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:48.643297 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:48.644720 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:48.644722 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:48.644722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:48.644730 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:48.646275 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.646636 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.646637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.646637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.646696 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:48.646898 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:48.646899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:48.646899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:48.647035 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:48.647126 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:48.647237 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:50:48.647323 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:50:48.682742 7173 catalog_manager.cc:1259] Loaded cluster ID: 5492a805cd6f4399828c34963da2a0e1
I20260811 00:50:48.682813 7173 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: loading cluster ID for follower catalog manager: success
I20260811 00:50:48.683570 7173 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: acquiring CA information for follower catalog manager: success
I20260811 00:50:48.683836 7173 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:50:49.604962 8418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:49.604692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:52433)
0811 00:50:49.604817 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:49.604901 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
W20260811 00:50:49.605255 8036 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:43841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:49.605518 8420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:49.605253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:47707)
0811 00:50:49.605377 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:49.605457 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":50,"threads_started":1}
W20260811 00:50:49.606067 7755 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:43841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:49.606082 8421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:49.605807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:43999)
0811 00:50:49.605958 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:49.606041 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":67,"threads_started":1}
W20260811 00:50:49.606272 8296 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:43841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.109724 8427 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd25cda1b02a432da0552de2e3f73206)
I20260811 00:50:50.109719 8424 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd25cda1b02a432da0552de2e3f73206)
I20260811 00:50:50.109835 8424 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:50.109865 8427 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:50.110051 8424 leader_election.cc:288] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221)
I20260811 00:50:50.110160 8427 leader_election.cc:288] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188:36089)
I20260811 00:50:50.110421 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50142)
0811 00:50:50.110313 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.110373 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":50,"threads_started":1}
I20260811 00:50:50.110571 8434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50156)
0811 00:50:50.110478 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.110528 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":52,"threads_started":1}
W20260811 00:50:50.110682 7044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
W20260811 00:50:50.110800 7395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.111106 8434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.111024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50168)
0811 00:50:50.111059 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.111081 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 00:50:50.111222 7044 leader_election.cc:334] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.111509 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.111394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50170)
0811 00:50:50.111450 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.111482 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 00:50:50.111637 7395 leader_election.cc:334] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.113520 8436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44582 (local address 127.26.99.188:36089)
0811 00:50:50.110642 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:50.110644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:50.110846 (+ 202us) server_negotiation.cc:407] Connection header received
0811 00:50:50.110877 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:50.110878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:50.110893 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:50.110948 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:50.111156 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.111874 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.112835 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.113212 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.113272 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:50.113284 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:50.113424 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 00:50:50.113463 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":40,"threads_started":1}
I20260811 00:50:50.113519 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:36089 (local address 127.0.0.1:44582)
0811 00:50:50.110681 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.110690 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:50.110761 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:50.111003 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:50.111004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:50.111007 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:50.111079 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:50.111081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.111950 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.111952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:50.112759 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:50.112761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.113279 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.113280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:50.113339 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:50.113358 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 00:50:50.113405 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:50:50.113451 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":44,"threads_started":1}
I20260811 00:50:50.113662 8437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.26.99.189:39221)
0811 00:50:50.110599 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:50.110600 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:50.110828 (+ 228us) server_negotiation.cc:407] Connection header received
0811 00:50:50.110945 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:50.110947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:50.110961 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:50.111008 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:50.111199 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.111863 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.112948 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.113350 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.113414 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:50.113474 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:50.113558 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 00:50:50.113598 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":52,"threads_started":1}
I20260811 00:50:50.113662 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.110362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:39221 (local address 127.0.0.1:33810)
0811 00:50:50.110597 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.110755 (+ 158us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:50.110864 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:50.111076 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:50.111076 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:50.111078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:50.111131 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:50.111133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.111932 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.111933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:50.112848 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:50.112851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:50.113427 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:50.113428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:50.113487 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:50.113492 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:50.113548 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:50:50.113593 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":54,"threads_started":1}
I20260811 00:50:50.113927 7441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" is_pre_election: true
I20260811 00:50:50.114053 7441 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0b4d7a572847ddb2ca6aa0545eadbf in term 1.
I20260811 00:50:50.114043 7092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" is_pre_election: true
I20260811 00:50:50.114131 7092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd72eaf4a3c04fb7b41ae580d0e70a78 in term 1.
I20260811 00:50:50.114223 7042 leader_election.cc:302] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd72eaf4a3c04fb7b41ae580d0e70a78; no voters: dd25cda1b02a432da0552de2e3f73206
I20260811 00:50:50.114264 7395 leader_election.cc:302] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd72eaf4a3c04fb7b41ae580d0e70a78; no voters: dd25cda1b02a432da0552de2e3f73206
I20260811 00:50:50.114341 8427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 00:50:50.114343 8424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 00:50:50.114393 8424 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd25cda1b02a432da0552de2e3f73206)
I20260811 00:50:50.114393 8427 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd25cda1b02a432da0552de2e3f73206)
I20260811 00:50:50.114414 8427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:50:50.114414 8424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:50:50.115301 8427 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:50.115285 8424 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:50.115414 8424 leader_election.cc:288] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 election: Requested vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221)
I20260811 00:50:50.115429 8427 leader_election.cc:288] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 election: Requested vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), dd72eaf4a3c04fb7b41ae580d0e70a78 (127.26.99.188:36089)
I20260811 00:50:50.115644 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.115558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50192)
0811 00:50:50.115591 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.115618 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 00:50:50.115669 7092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
I20260811 00:50:50.115839 7092 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dd72eaf4a3c04fb7b41ae580d0e70a78 in current term 2: Already voted for candidate 0f0b4d7a572847ddb2ca6aa0545eadbf in this term.
I20260811 00:50:50.115991 8430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.115858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50202)
0811 00:50:50.115887 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.115911 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260811 00:50:50.115789 7441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78"
W20260811 00:50:50.116096 7044 leader_election.cc:334] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.116117 7441 raft_consensus.cc:2379] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f0b4d7a572847ddb2ca6aa0545eadbf in current term 2: Already voted for candidate dd72eaf4a3c04fb7b41ae580d0e70a78 in this term.
I20260811 00:50:50.115613 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.115522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50184)
0811 00:50:50.115556 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.115585 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 00:50:50.116285 7042 leader_election.cc:302] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f0b4d7a572847ddb2ca6aa0545eadbf; no voters: dd25cda1b02a432da0552de2e3f73206, dd72eaf4a3c04fb7b41ae580d0e70a78
I20260811 00:50:50.116413 8427 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 00:50:50.116477 8435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.116392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50204)
0811 00:50:50.116420 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.116447 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 00:50:50.116535 7395 leader_election.cc:334] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:50.116575 7395 leader_election.cc:302] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd72eaf4a3c04fb7b41ae580d0e70a78; no voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd25cda1b02a432da0552de2e3f73206
I20260811 00:50:50.116642 8424 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 00:50:50.607805 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.606096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:49361)
0811 00:50:50.607302 (+ 1206us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.607491 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1100,"thread_start_us":386,"threads_started":1}
I20260811 00:50:50.608909 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.607252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:56007)
0811 00:50:50.608322 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.608680 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":215,"threads_started":1}
I20260811 00:50:50.609591 8449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:50.607331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:38267)
0811 00:50:50.609216 (+ 1885us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:50.609398 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1796,"thread_start_us":281,"threads_started":1}
I20260811 00:50:51.609529 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.609299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:55929)
0811 00:50:51.609424 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.609471 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260811 00:50:51.610527 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.610355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:56989)
0811 00:50:51.610448 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.610483 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":55,"threads_started":1}
I20260811 00:50:51.610589 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.610352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:35127)
0811 00:50:51.610513 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.610547 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260811 00:50:51.640869 8455 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:51.640964 8455 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:51.641156 8455 leader_election.cc:288] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221)
I20260811 00:50:51.641486 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.641302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50386)
0811 00:50:51.641393 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.641444 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":41,"threads_started":1}
I20260811 00:50:51.641575 7092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" is_pre_election: true
I20260811 00:50:51.641698 7092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd72eaf4a3c04fb7b41ae580d0e70a78 in term 2.
I20260811 00:50:51.641866 7395 leader_election.cc:302] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd72eaf4a3c04fb7b41ae580d0e70a78; no voters:
I20260811 00:50:51.641920 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.641819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50388)
0811 00:50:51.641864 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.641894 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 00:50:51.641963 8455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260811 00:50:51.641993 7395 leader_election.cc:334] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:51.641999 8455 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:51.642046 8455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:50:51.642776 8455 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:51.642907 8455 leader_election.cc:288] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 election: Requested vote from peers dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841), 0f0b4d7a572847ddb2ca6aa0545eadbf (127.26.99.189:39221)
I20260811 00:50:51.643072 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.642981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50394)
0811 00:50:51.643016 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.643048 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 00:50:51.643158 7092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf"
I20260811 00:50:51.643249 7092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:50:51.643376 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.643290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50396)
0811 00:50:51.643330 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.643352 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 00:50:51.643455 7395 leader_election.cc:334] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
I20260811 00:50:51.643911 7092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd72eaf4a3c04fb7b41ae580d0e70a78 in term 3.
I20260811 00:50:51.644066 7395 leader_election.cc:302] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f0b4d7a572847ddb2ca6aa0545eadbf, dd72eaf4a3c04fb7b41ae580d0e70a78; no voters: dd25cda1b02a432da0552de2e3f73206
I20260811 00:50:51.644241 8455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 00:50:51.644385 8455 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [term 3 LEADER]: Becoming Leader. State: Replica: dd72eaf4a3c04fb7b41ae580d0e70a78, State: Running, Role: LEADER
I20260811 00:50:51.644470 8455 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } }
I20260811 00:50:51.644794 8455 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd72eaf4a3c04fb7b41ae580d0e70a78. Latest consensus state: current_term: 3 leader_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:51.644871 8455 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:51.645038 8465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:51.645473 8465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:51.645539 8465 catalog_manager.cc:1259] Loaded cluster ID: 5492a805cd6f4399828c34963da2a0e1
I20260811 00:50:51.645561 8465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:51.645711 8465 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:51.645766 8465 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Loaded TSK: 0
I20260811 00:50:51.645859 8465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:50:51.725529 7422 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44574:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:51.727077 7422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:51.728021 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.727931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50422)
0811 00:50:51.727963 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.727993 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 00:50:51.728020 7092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [term 3 FOLLOWER]: Refusing update from remote peer dd72eaf4a3c04fb7b41ae580d0e70a78: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 00:50:51.728317 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.728244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.0.0.1:50430)
0811 00:50:51.728272 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.728294 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 00:50:51.728354 8461 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 00:50:51.728504 7395 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 -> Peer dd25cda1b02a432da0552de2e3f73206 (127.26.99.190:43841): Couldn't send request to peer dd25cda1b02a432da0552de2e3f73206. Status: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 00:50:51.728986 8467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd72eaf4a3c04fb7b41ae580d0e70a78. Latest consensus state: current_term: 3 leader_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:51.729089 8467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:50:51.729394 8466 mvcc.cc:205] Tried to move back new op lower bound from 7317133114276200448 to 7317133113936449536. Current Snapshot: MvccSnapshot[applied={T|T < 7317133114276200448}]
I20260811 00:50:51.729501 8455 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:51.729600 8455 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:51.729677 8467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "dd25cda1b02a432da0552de2e3f73206" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 43841 } } peers { permanent_uuid: "0f0b4d7a572847ddb2ca6aa0545eadbf" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 39221 } attrs { promote: false } } peers { permanent_uuid: "dd72eaf4a3c04fb7b41ae580d0e70a78" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 36089 } attrs { promote: false } } }
I20260811 00:50:51.729790 8467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0b4d7a572847ddb2ca6aa0545eadbf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:50:51.734673 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36603 (local address 127.0.0.1:57804)
0811 00:50:51.731838 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.731846 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:51.731892 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:51.732086 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:51.732087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:51.732089 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:51.732124 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.732125 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.733015 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.733016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.733812 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.733815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.734438 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.734500 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.734504 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:51.734558 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:50:51.734596 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":97,"threads_started":1}
I20260811 00:50:51.734685 8486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57804 (local address 127.26.99.129:36603)
0811 00:50:51.731832 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:51.731833 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:51.731955 (+ 122us) server_negotiation.cc:407] Connection header received
0811 00:50:51.731989 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:51.731990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:51.732002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:51.732072 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:51.732203 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.732937 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.733896 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.734360 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734431 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.734453 (+ 22us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:51.734568 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:50:51.734606 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260811 00:50:51.734948 8482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:35833 (local address 127.0.0.1:37528)
0811 00:50:51.731648 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.731656 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:51.731694 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:51.731886 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:51.731887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:51.731890 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:51.731951 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.731953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.732910 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.732911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.734070 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.734072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.734725 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.734797 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.734801 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:50:51.734845 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:51.734883 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":26,"thread_start_us":66,"threads_started":1}
I20260811 00:50:51.734951 7634 tablet_service.cc:1467] Processing CreateTablet for tablet d651d8505af4426987485270856b4070 (DEFAULT_TABLE table=test-table [id=eebd229de6ef4ee4b0a30bc937d5429a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:51.735095 7634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d651d8505af4426987485270856b4070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:51.735152 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37528 (local address 127.26.99.130:35833)
0811 00:50:51.731690 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:51.731692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:51.731762 (+ 70us) server_negotiation.cc:407] Connection header received
0811 00:50:51.731790 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:51.731792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:51.731803 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:51.731890 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:51.732031 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.732839 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734168 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.734625 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734680 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.734692 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:51.735039 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 00:50:51.735085 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":48,"threads_started":1}
I20260811 00:50:51.735327 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39907 (local address 127.0.0.1:33866)
0811 00:50:51.731571 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.731581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:51.731631 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:51.732153 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:51.732153 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:51.732155 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:51.732217 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.732219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.732859 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.732860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.734069 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:51.734072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.735117 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.735118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:51.735191 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.735196 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:51.735226 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 00:50:51.735267 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":31}
I20260811 00:50:51.735349 7898 tablet_service.cc:1467] Processing CreateTablet for tablet d651d8505af4426987485270856b4070 (DEFAULT_TABLE table=test-table [id=eebd229de6ef4ee4b0a30bc937d5429a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:51.735467 7898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d651d8505af4426987485270856b4070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:51.735689 8487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.731716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33866 (local address 127.26.99.131:39907)
0811 00:50:51.732011 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:51.732013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:51.732021 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:51.732045 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:51.732046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:51.732056 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:51.732145 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:51.732278 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.732791 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.734151 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:51.734951 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:51.735542 (+ 591us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:51.735557 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:51.735577 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 00:50:51.735620 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":69,"threads_started":1}
I20260811 00:50:51.735997 8168 tablet_service.cc:1467] Processing CreateTablet for tablet d651d8505af4426987485270856b4070 (DEFAULT_TABLE table=test-table [id=eebd229de6ef4ee4b0a30bc937d5429a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:51.736119 8168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d651d8505af4426987485270856b4070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:51.736644 8488 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: Bootstrap starting.
I20260811 00:50:51.737078 8488 tablet_bootstrap.cc:654] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:51.737454 8492 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Bootstrap starting.
I20260811 00:50:51.737641 8490 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Bootstrap starting.
I20260811 00:50:51.737771 8492 tablet_bootstrap.cc:654] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:51.737995 8490 tablet_bootstrap.cc:654] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:51.738139 8488 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: No bootstrap required, opened a new log
I20260811 00:50:51.738195 8488 ts_tablet_manager.cc:1397] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:51.738348 8488 raft_consensus.cc:348] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.738389 8492 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: No bootstrap required, opened a new log
I20260811 00:50:51.738423 8488 raft_consensus.cc:374] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:51.738444 8488 raft_consensus.cc:729] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9638f71383a48bc90e230436eb7c5be, State: Initialized, Role: FOLLOWER
I20260811 00:50:51.738494 8488 consensus_queue.cc:260] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.738552 8490 tablet_bootstrap.cc:492] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: No bootstrap required, opened a new log
I20260811 00:50:51.738603 8490 ts_tablet_manager.cc:1397] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:51.738665 8488 ts_tablet_manager.cc:1428] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:51.738667 8492 ts_tablet_manager.cc:1397] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:51.739140 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.739035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:59151)
0811 00:50:51.739085 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.739114 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:50:51.739259 7752 heartbeater.cc:503] Master 127.26.99.188:36089 was elected leader, sending a full tablet report...
I20260811 00:50:51.738734 8490 raft_consensus.cc:348] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.739318 8490 raft_consensus.cc:374] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:51.739351 8490 raft_consensus.cc:729] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1760bf948aed407d91dde79eba1cf0bc, State: Initialized, Role: FOLLOWER
I20260811 00:50:51.739382 8492 raft_consensus.cc:348] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.739475 8492 raft_consensus.cc:374] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:51.739498 8492 raft_consensus.cc:729] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c2a8ec0b4654884b6dbeb5d6976e286, State: Initialized, Role: FOLLOWER
I20260811 00:50:51.739553 8492 consensus_queue.cc:260] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.739415 8490 consensus_queue.cc:260] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:51.739797 8490 ts_tablet_manager.cc:1428] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:51.739871 8492 ts_tablet_manager.cc:1428] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:51.740208 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.740034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:42469)
0811 00:50:51.740156 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.740183 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260811 00:50:51.740253 8295 heartbeater.cc:503] Master 127.26.99.188:36089 was elected leader, sending a full tablet report...
I20260811 00:50:51.740280 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.740188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:50295)
0811 00:50:51.740229 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.740253 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 00:50:51.740782 8032 heartbeater.cc:503] Master 127.26.99.188:36089 was elected leader, sending a full tablet report...
I20260811 00:50:51.740850 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.740754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:58611)
0811 00:50:51.740797 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.740825 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:50:51.740967 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:51.740879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:35059)
0811 00:50:51.740923 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:51.740945 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 00:50:51.873286 7763 tablet.cc:2369] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:51.923882 8299 tablet.cc:2369] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:52.007261 8497 raft_consensus.cc:482] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:52.007359 8497 raft_consensus.cc:504] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:52.007761 8497 leader_election.cc:288] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907), d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:52.011925 8487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.008003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:58869 (local address 127.26.99.131:39907)
0811 00:50:52.008051 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:52.008053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:52.008064 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:52.008140 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:52.008142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:52.008152 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:52.008207 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:52.008383 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.009155 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.010922 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.011485 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.011572 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:52.011584 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:52.011797 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 00:50:52.011847 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:52.011924 8486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.008054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:42715 (local address 127.26.99.129:36603)
0811 00:50:52.008098 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:52.008100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:52.008246 (+ 146us) server_negotiation.cc:407] Connection header received
0811 00:50:52.008279 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:52.008280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:52.008288 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:52.008350 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:52.008453 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.009155 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.010916 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.011502 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.011572 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:52.011584 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:52.011797 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 00:50:52.011847 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:50:52.011927 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.007936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39907 (local address 127.26.99.130:58869)
0811 00:50:52.008009 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.008020 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:52.008075 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:52.008226 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:52.008227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:52.008231 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:52.008298 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:52.008300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.009259 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.009262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:52.010803 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:52.010807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.011595 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.011597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:52.011698 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:52.011705 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:50:52.011770 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:50:52.011826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":59}
I20260811 00:50:52.011951 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.007976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36603 (local address 127.26.99.130:42715)
0811 00:50:52.008171 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.008179 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:52.008233 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:52.008359 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:52.008359 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:52.008361 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:52.008394 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:52.008395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.009259 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.009262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:52.010806 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:52.010808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.011599 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.011600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:52.011698 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:52.011707 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 00:50:52.011770 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:50:52.011826 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":128,"thread_start_us":115,"threads_started":1}
I20260811 00:50:52.012241 8210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d651d8505af4426987485270856b4070" candidate_uuid: "1760bf948aed407d91dde79eba1cf0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" is_pre_election: true
I20260811 00:50:52.012246 7666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d651d8505af4426987485270856b4070" candidate_uuid: "1760bf948aed407d91dde79eba1cf0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9638f71383a48bc90e230436eb7c5be" is_pre_election: true
I20260811 00:50:52.012367 8210 raft_consensus.cc:2454] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1760bf948aed407d91dde79eba1cf0bc in term 0.
I20260811 00:50:52.012424 7666 raft_consensus.cc:2454] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1760bf948aed407d91dde79eba1cf0bc in term 0.
I20260811 00:50:52.012615 7810 leader_election.cc:302] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1760bf948aed407d91dde79eba1cf0bc, 5c2a8ec0b4654884b6dbeb5d6976e286; no voters:
I20260811 00:50:52.012771 8497 raft_consensus.cc:2781] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:52.012811 8497 raft_consensus.cc:482] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:52.012830 8497 raft_consensus.cc:3037] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:52.013525 8497 raft_consensus.cc:504] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:52.013659 8497 leader_election.cc:288] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [CANDIDATE]: Term 1 election: Requested vote from peers 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907), d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603)
I20260811 00:50:52.013816 8210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d651d8505af4426987485270856b4070" candidate_uuid: "1760bf948aed407d91dde79eba1cf0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286"
I20260811 00:50:52.013899 8210 raft_consensus.cc:3037] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:52.014022 7666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d651d8505af4426987485270856b4070" candidate_uuid: "1760bf948aed407d91dde79eba1cf0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9638f71383a48bc90e230436eb7c5be"
I20260811 00:50:52.014223 7666 raft_consensus.cc:3037] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:52.014607 8210 raft_consensus.cc:2454] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1760bf948aed407d91dde79eba1cf0bc in term 1.
I20260811 00:50:52.014760 7810 leader_election.cc:302] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1760bf948aed407d91dde79eba1cf0bc, 5c2a8ec0b4654884b6dbeb5d6976e286; no voters:
I20260811 00:50:52.014845 8497 raft_consensus.cc:2781] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:52.014997 7666 raft_consensus.cc:2454] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1760bf948aed407d91dde79eba1cf0bc in term 1.
I20260811 00:50:52.015009 8497 raft_consensus.cc:686] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 1 LEADER]: Becoming Leader. State: Replica: 1760bf948aed407d91dde79eba1cf0bc, State: Running, Role: LEADER
I20260811 00:50:52.015079 8497 consensus_queue.cc:237] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } }
I20260811 00:50:52.015702 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.015591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:41747)
0811 00:50:52.015633 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.015670 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 00:50:52.015811 7423 catalog_manager.cc:5495] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130). New cstate: current_term: 1 leader_uuid: "1760bf948aed407d91dde79eba1cf0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1760bf948aed407d91dde79eba1cf0bc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 35833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:52.087072 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.084960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.26.99.130:35833)
0811 00:50:52.085023 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:52.085024 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:52.085032 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:52.085070 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:52.085071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:52.085088 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:52.085148 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:52.085241 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.085712 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.086439 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:52.086644 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:52.086707 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:52.086814 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:52.086916 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:52.086963 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:52.086993 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 00:50:52.087013 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:50:52.088137 8210 raft_consensus.cc:1261] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Refusing update from remote peer 1760bf948aed407d91dde79eba1cf0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:52.088227 7666 raft_consensus.cc:1261] T d651d8505af4426987485270856b4070 P d9638f71383a48bc90e230436eb7c5be [term 1 FOLLOWER]: Refusing update from remote peer 1760bf948aed407d91dde79eba1cf0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:52.088472 8501 consensus_queue.cc:1035] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c2a8ec0b4654884b6dbeb5d6976e286" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:52.088606 8497 consensus_queue.cc:1035] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9638f71383a48bc90e230436eb7c5be" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:52.089838 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.089702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:41675)
0811 00:50:52.089762 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.089803 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 00:50:52.090065 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.089928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:33917)
0811 00:50:52.090007 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.090033 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 00:50:52.090775 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.090683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:39985)
0811 00:50:52.090719 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.090750 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 00:50:52.090775 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.090670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.131:53183)
0811 00:50:52.090719 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.090750 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 00:50:52.091122 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.091019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.130:51999)
0811 00:50:52.091075 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.091098 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 00:50:52.091410 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:52.091293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:43841 (local address 127.26.99.129:58695)
0811 00:50:52.091362 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.091384 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:43841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 00:50:52.093743 7423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:52.093823 7423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44574:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:52.095031 7423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd72eaf4a3c04fb7b41ae580d0e70a78: Sending DeleteTablet for 3 replicas of tablet d651d8505af4426987485270856b4070
I20260811 00:50:52.095337 8168 tablet_service.cc:1514] Processing DeleteTablet for tablet d651d8505af4426987485270856b4070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:52 UTC) from {username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:33866
I20260811 00:50:52.095629 8518 tablet_replica.cc:330] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: stopping tablet replica
I20260811 00:50:52.095623 7898 tablet_service.cc:1514] Processing DeleteTablet for tablet d651d8505af4426987485270856b4070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:52 UTC) from {username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:37528
I20260811 00:50:52.095681 8518 raft_consensus.cc:2229] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:52.095712 8518 raft_consensus.cc:2258] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:52.095866 7634 tablet_service.cc:1514] Processing DeleteTablet for tablet d651d8505af4426987485270856b4070 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:52 UTC) from {username='oryx', principal='oryx/127.26.99.188@KRBTEST.COM'} at 127.0.0.1:57804
I20260811 00:50:52.095891 8519 tablet_replica.cc:330] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: stopping tablet replica
I20260811 00:50:52.095939 8519 raft_consensus.cc:2229] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:52.096011 8519 raft_consensus.cc:2258] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:52.096113 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 7348
I20260811 00:50:52.101501 8518 ts_tablet_manager.cc:1905] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:52.103205 8518 ts_tablet_manager.cc:1918] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:52.103293 8518 log.cc:1196] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/d651d8505af4426987485270856b4070
I20260811 00:50:52.103533 8518 ts_tablet_manager.cc:1939] T d651d8505af4426987485270856b4070 P 5c2a8ec0b4654884b6dbeb5d6976e286: Deleting consensus metadata
I20260811 00:50:52.105075 7397 catalog_manager.cc:4841] TS 5c2a8ec0b4654884b6dbeb5d6976e286 (127.26.99.131:39907): tablet d651d8505af4426987485270856b4070 (table test-table [id=eebd229de6ef4ee4b0a30bc937d5429a]) successfully deleted
I20260811 00:50:52.105484 8519 ts_tablet_manager.cc:1905] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:52.106750 8519 ts_tablet_manager.cc:1918] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:52.106793 8519 log.cc:1196] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/d651d8505af4426987485270856b4070
I20260811 00:50:52.106986 8519 ts_tablet_manager.cc:1939] T d651d8505af4426987485270856b4070 P 1760bf948aed407d91dde79eba1cf0bc: Deleting consensus metadata
I20260811 00:50:52.107386 7394 catalog_manager.cc:4841] TS 1760bf948aed407d91dde79eba1cf0bc (127.26.99.130:35833): tablet d651d8505af4426987485270856b4070 (table test-table [id=eebd229de6ef4ee4b0a30bc937d5429a]) successfully deleted
W20260811 00:50:52.115773 8457 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:52.115623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36603 (local address 127.0.0.1:57818)
0811 00:50:52.115691 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:52.115719 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36603: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 00:50:52.115933 7393 catalog_manager.cc:4584] TS d9638f71383a48bc90e230436eb7c5be (127.26.99.129:36603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d651d8505af4426987485270856b4070: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36603: connect: Connection reset by peer (error 104)
I20260811 00:50:52.116010 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 7769
I20260811 00:50:52.125770 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 8047
I20260811 00:50:52.136153 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 6812
I20260811 00:50:52.144302 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 7177
2026-08-11T00:50:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6671 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:52 dist-test-slave-xt4k krb5kdc[8530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:52 dist-test-slave-xt4k krb5kdc[8530](info): set up 2 sockets
Aug 11 00:50:52 dist-test-slave-xt4k krb5kdc[8530](info): commencing operation
krb5kdc: starting...
W20260811 00:50:53.336738 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab.
Entry for principal oryx/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab.
I20260811 00:50:53.458595 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39277
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab
--principal=oryx/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:39277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:53.544013 8557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:53.544220 8557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:53.544251 8557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:53.545441 8557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:53.545485 8557 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 00:50:53.545501 8557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:53.545518 8557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:53.545534 8557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:53.545555 8557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:53.547082 8557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:39277
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.190.keytab
--principal=oryx/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:53.547330 8557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:53.547529 8557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:53.552188 8566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:53.552186 8570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:53.552312 8557 server_base.cc:1034] running on GCE node
W20260811 00:50:53.552212 8564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:53.552695 8557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:53.552968 8557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:53.554122 8557 hybrid_clock.cc:648] HybridClock initialized: now 1786409453554107 us; error 30 us; skew 500 ppm
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:53.556782 8557 init.cc:377] Logged in from keytab as oryx/127.26.99.190@KRBTEST.COM (short username oryx)
I20260811 00:50:53.557197 8557 webserver.cc:460] Webserver started at http://127.26.99.190:41027/ using document root <none> and password file <none>
I20260811 00:50:53.557418 8557 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:53.557466 8557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:53.557597 8557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:53.558638 8557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "5386be974f384d4c8bdde429482955f0"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "03ae17af8c51da6e340540799cbcca45"
server_key_iv: "c3a9352f9e175197508f494fb84f7162"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.558972 8557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "5386be974f384d4c8bdde429482955f0"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "03ae17af8c51da6e340540799cbcca45"
server_key_iv: "c3a9352f9e175197508f494fb84f7162"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.560268 8557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:50:53.561072 8583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.561221 8557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:53.561303 8557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "5386be974f384d4c8bdde429482955f0"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "03ae17af8c51da6e340540799cbcca45"
server_key_iv: "c3a9352f9e175197508f494fb84f7162"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.561370 8557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:53.570787 8557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:53.572901 8557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:53.573040 8557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:53.577543 8557 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:39277
I20260811 00:50:53.577607 8697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:39277 every 8 connection(s)
I20260811 00:50:53.577993 8557 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:53.578816 8701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:53.581245 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Bootstrap starting.
I20260811 00:50:53.582082 8701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:53.582396 8701 log.cc:824] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:53.583072 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: No bootstrap required, opened a new log
I20260811 00:50:53.583837 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 8557
I20260811 00:50:53.583921 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:53.584113 27022 external_mini_cluster.cc:1428] Setting key 29843d85a67bf0441e2f6a53b696e06f
I20260811 00:50:53.585500 8701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } }
I20260811 00:50:53.585670 8701 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:53.585707 8701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5386be974f384d4c8bdde429482955f0, State: Initialized, Role: FOLLOWER
I20260811 00:50:53.585858 8701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } }
I20260811 00:50:53.585929 8701 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:53.585950 8701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:53.585984 8701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:53.586613 8701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } }
I20260811 00:50:53.586721 8701 leader_election.cc:302] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5386be974f384d4c8bdde429482955f0; no voters:
I20260811 00:50:53.586912 8701 leader_election.cc:288] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:53.586988 8715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:53.587232 8701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:53.587273 8715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [term 1 LEADER]: Becoming Leader. State: Replica: 5386be974f384d4c8bdde429482955f0, State: Running, Role: LEADER
I20260811 00:50:53.587509 8715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } }
I20260811 00:50:53.587898 8715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5386be974f384d4c8bdde429482955f0. Latest consensus state: current_term: 1 leader_uuid: "5386be974f384d4c8bdde429482955f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } } }
I20260811 00:50:53.587908 8716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5386be974f384d4c8bdde429482955f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5386be974f384d4c8bdde429482955f0" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39277 } } }
I20260811 00:50:53.588024 8715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:53.588120 8716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0 [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:53.588294 8732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:53.588948 8732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:53.591261 8732 catalog_manager.cc:1347] Generated new cluster ID: f74e2796784b4a14a8fed5b2e349ebd9
I20260811 00:50:53.591315 8732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:53.595935 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.584633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36192 (local address 127.26.99.190:39277)
0811 00:50:53.584839 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:53.584850 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:53.584888 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:50:53.585465 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:53.585474 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:53.585550 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:53.585701 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:53.586382 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.587787 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.588847 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.589344 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.589526 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.592166 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:53.592170 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:53.592171 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:53.592183 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:53.594057 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.594413 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.594416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.594416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.594539 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.594713 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.594714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.594714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.594991 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:53.595137 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:53.595610 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 00:50:53.595744 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260811 00:50:53.601003 8732 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:53.601509 8732 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:53.604940 8732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Generated new TSK 0
I20260811 00:50:53.605113 8732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
I20260811 00:50:53.634994 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39277
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:53.717042 8755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:53.717254 8755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:53.717279 8755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:53.718447 8755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:53.718490 8755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:53.718510 8755 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:53.718528 8755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:53.720082 8755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:39277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:53.720306 8755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:53.720602 8755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:53.725487 8763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:53.725487 8762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:53.725526 8767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:53.725736 8755 server_base.cc:1034] running on GCE node
I20260811 00:50:53.725994 8755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:53.726262 8755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:53.727458 8755 hybrid_clock.cc:648] HybridClock initialized: now 1786409453727430 us; error 44 us; skew 500 ppm
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:53.729868 8755 init.cc:377] Logged in from keytab as oryx/127.26.99.129@KRBTEST.COM (short username oryx)
I20260811 00:50:53.730276 8755 webserver.cc:460] Webserver started at http://127.26.99.129:34673/ using document root <none> and password file <none>
I20260811 00:50:53.730475 8755 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:53.730525 8755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:53.730647 8755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:53.731720 8755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "740987ba96374a29a44537b48172a825"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "c179786edc15de68adecb7991d83c1bd"
server_key_iv: "df6a0c5f4bca34c927de3d7d07bcbdc5"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.732056 8755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "740987ba96374a29a44537b48172a825"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "c179786edc15de68adecb7991d83c1bd"
server_key_iv: "df6a0c5f4bca34c927de3d7d07bcbdc5"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.733495 8755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:53.734207 8779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.734368 8755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:53.734452 8755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "740987ba96374a29a44537b48172a825"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "c179786edc15de68adecb7991d83c1bd"
server_key_iv: "df6a0c5f4bca34c927de3d7d07bcbdc5"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.734513 8755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:53.747825 8755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:53.749846 8755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:53.749984 8755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:53.750469 8755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:53.750510 8755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.750542 8755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:53.750559 8755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.757045 8755 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:40865
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:53.757192 8988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:40865 every 8 connection(s)
I20260811 00:50:53.757416 8755 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:53.760160 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.750962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:40731 (local address 127.26.99.190:39277)
0811 00:50:53.751031 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:53.751034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:53.751197 (+ 163us) server_negotiation.cc:407] Connection header received
0811 00:50:53.751671 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:53.751672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:53.751690 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:53.751760 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:53.752577 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.753323 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.754826 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.755139 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.755205 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.757715 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:53.757717 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:53.757717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:53.757725 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:53.758848 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.759219 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.759220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.759220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.759274 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.759484 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.759485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.759486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.759610 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:53.759678 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:53.759994 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 00:50:53.760075 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:50:53.760250 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.750904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.129:40731)
0811 00:50:53.751069 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:53.751109 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:53.751574 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:53.751835 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:53.751839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:53.752181 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:53.752490 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.752496 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.753424 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.753425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.754740 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.754744 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.755219 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.755220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.755362 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.755868 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:53.755880 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:53.757612 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:53.758922 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.758928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.758930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.759151 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.759318 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.759318 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.759319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.759406 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.759713 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:53.759720 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:53.759843 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 00:50:53.759938 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:50:53.760064 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260811 00:50:53.760371 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 8755
I20260811 00:50:53.760478 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:53.760694 27022 external_mini_cluster.cc:1428] Setting key eb535244f63ff44287c69db337a9eb97
I20260811 00:50:53.760807 8989 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39277
I20260811 00:50:53.760886 8989 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:53.761083 8989 heartbeater.cc:511] Master 127.26.99.190:39277 requested a full tablet report, sending...
I20260811 00:50:53.761654 8617 ts_manager.cc:194] Registered new tserver with Master: 740987ba96374a29a44537b48172a825 (127.26.99.129:40865)
I20260811 00:50:53.762312 8617 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:40731
I20260811 00:50:53.768687 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.761915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:54907 (local address 127.26.99.190:39277)
0811 00:50:53.761974 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:53.761976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:53.763262 (+ 1286us) server_negotiation.cc:407] Connection header received
0811 00:50:53.763289 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:53.763290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:53.763299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:53.763357 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:53.763706 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.764229 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.765133 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.765337 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.765390 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.766426 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:53.766427 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:53.766427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:53.766435 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:53.767645 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.768040 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.768041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.768041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.768084 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.768261 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.768261 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.768261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.768380 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:53.768429 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:53.768567 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 00:50:53.768628 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:50:53.768754 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.761771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.129:54907)
0811 00:50:53.763170 (+ 1399us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:53.763182 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:53.763247 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:53.763372 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:53.763372 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:53.763567 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:53.763637 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.763639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.764324 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.764325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.765043 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.765047 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.765405 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.765406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.765490 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.765944 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:53.765949 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:53.766340 (+ 391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:53.767743 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.767744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.767745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.767971 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.768140 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.768141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.768141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.768210 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.768425 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:53.768426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:53.768477 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 00:50:53.768550 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:50:53.768652 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"thread_start_us":61,"threads_started":1}
WARNING: no policy specified for oryx/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
I20260811 00:50:53.785458 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39277
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:53.867539 9007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:53.867748 9007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:53.867772 9007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:53.868952 9007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:53.868993 9007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:53.869014 9007 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:53.869029 9007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:53.870533 9007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:39277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:53.870787 9007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:53.870987 9007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:53.875653 9027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:53.875689 9025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:53.875689 9030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:53.875880 9007 server_base.cc:1034] running on GCE node
I20260811 00:50:53.876127 9007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:53.876377 9007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:53.877525 9007 hybrid_clock.cc:648] HybridClock initialized: now 1786409453877515 us; error 26 us; skew 500 ppm
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:53.879997 9007 init.cc:377] Logged in from keytab as oryx/127.26.99.130@KRBTEST.COM (short username oryx)
I20260811 00:50:53.880491 9007 webserver.cc:460] Webserver started at http://127.26.99.130:42187/ using document root <none> and password file <none>
I20260811 00:50:53.880710 9007 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:53.880760 9007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:53.880893 9007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:53.881894 9007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "d533c699ce6e820715abbb78d13bd922"
server_key_iv: "9bd3fa0bc23bf1cbe915fc968fff12be"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.882232 9007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "d533c699ce6e820715abbb78d13bd922"
server_key_iv: "9bd3fa0bc23bf1cbe915fc968fff12be"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.883553 9007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:53.884239 9044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.884420 9007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:53.884511 9007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
format_stamp: "Formatted at 2026-08-11 00:50:53 on dist-test-slave-xt4k"
server_key: "d533c699ce6e820715abbb78d13bd922"
server_key_iv: "9bd3fa0bc23bf1cbe915fc968fff12be"
server_key_version: "encryptionkey@0"
I20260811 00:50:53.884581 9007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:53.899993 9007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:53.902154 9007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:53.902295 9007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:53.902817 9007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:53.902858 9007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.902889 9007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:53.902906 9007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:53.909373 9007 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:41099
Aug 11 00:50:53 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:53.909432 9266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:41099 every 8 connection(s)
I20260811 00:50:53.909842 9007 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:53.910792 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 9007
I20260811 00:50:53.910907 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:53.911129 27022 external_mini_cluster.cc:1428] Setting key ff19ecb3e444a82d3f819152fb11f308
I20260811 00:50:53.912747 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.903293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:57443 (local address 127.26.99.190:39277)
0811 00:50:53.903344 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:53.903347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:53.903562 (+ 215us) server_negotiation.cc:407] Connection header received
0811 00:50:53.904068 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:53.904069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:53.904082 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:53.904141 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:53.905012 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.905767 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.907216 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.907502 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.907579 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.909938 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:53.909940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:53.909940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:53.909949 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:53.911361 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.911738 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.911739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.911739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.911803 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.912034 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.912035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.912036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.912167 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:53.912234 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:53.912578 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 00:50:53.912660 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:53.912963 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.903279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.130:57443)
0811 00:50:53.903427 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:53.903480 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:53.903974 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:53.904213 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:53.904216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:53.904619 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:53.904896 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.904903 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.905859 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.905860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.907122 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.907125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.907579 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.907580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.907688 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.908175 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:53.908185 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:53.909821 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:53.911451 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.911457 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.911459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.911669 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.911863 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.911863 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.911864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.911973 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.912265 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:53.912272 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:53.912440 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 00:50:53.912542 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 00:50:53.912672 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":83,"threads_started":1}
I20260811 00:50:53.913879 9269 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39277
I20260811 00:50:53.913975 9269 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:53.914150 9269 heartbeater.cc:511] Master 127.26.99.190:39277 requested a full tablet report, sending...
I20260811 00:50:53.914512 8618 ts_manager.cc:194] Registered new tserver with Master: 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099)
I20260811 00:50:53.914955 8618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:57443
WARNING: no policy specified for oryx/127.26.99.131@KRBTEST.COM; defaulting to no policy
I20260811 00:50:53.921175 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.914960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:46681 (local address 127.26.99.190:39277)
0811 00:50:53.915000 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:53.915002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:53.915125 (+ 123us) server_negotiation.cc:407] Connection header received
0811 00:50:53.915204 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:53.915205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:53.915215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:53.915260 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:53.915957 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.916694 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.917431 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.917630 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.917685 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.918620 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:53.918621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:53.918622 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:53.918629 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:53.919927 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.920266 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.920268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.920268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.920417 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:53.920601 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:53.920602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:53.920602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:53.920801 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:53.920861 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:53.921007 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 00:50:53.921080 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:53.921187 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:53.914895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.130:46681)
0811 00:50:53.915064 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:53.915074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:53.915150 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:53.915678 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:53.915679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:53.915827 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:53.915877 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.915878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.916807 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.916808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.917339 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:53.917341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:53.917689 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:53.917691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:53.917816 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:53.918219 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:53.918223 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:53.918540 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:53.920016 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.920017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.920018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.920202 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.920483 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:53.920484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:53.920484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:53.920546 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:53.920868 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:53.920869 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:53.920917 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 00:50:53.920977 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:50:53.921083 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":77,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
I20260811 00:50:53.937261 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39277
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:54.021607 9289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:54.021828 9289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:54.021862 9289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:54.023051 9289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:54.023092 9289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:54.023118 9289 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 00:50:54.023141 9289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:54.024708 9289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.99.190:39277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:54.024955 9289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:54.025168 9289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:50:54.030131 9289 server_base.cc:1034] running on GCE node
W20260811 00:50:54.030038 9299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:54.030055 9296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:54.030072 9295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:54.030436 9289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:54.030680 9289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:54.031844 9289 hybrid_clock.cc:648] HybridClock initialized: now 1786409454031830 us; error 32 us; skew 500 ppm
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409454, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:54.034368 9289 init.cc:377] Logged in from keytab as oryx/127.26.99.131@KRBTEST.COM (short username oryx)
I20260811 00:50:54.034824 9289 webserver.cc:460] Webserver started at http://127.26.99.131:41413/ using document root <none> and password file <none>
I20260811 00:50:54.035028 9289 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:54.035071 9289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:54.035197 9289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:54.036278 9289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "024f434293cf48ca8e9fbc471c3ca0af"
format_stamp: "Formatted at 2026-08-11 00:50:54 on dist-test-slave-xt4k"
server_key: "24c8eba91534ab36299e8316b4bd2873"
server_key_iv: "db6c17ca00e79dd0570b58b291d73033"
server_key_version: "encryptionkey@0"
I20260811 00:50:54.036664 9289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "024f434293cf48ca8e9fbc471c3ca0af"
format_stamp: "Formatted at 2026-08-11 00:50:54 on dist-test-slave-xt4k"
server_key: "24c8eba91534ab36299e8316b4bd2873"
server_key_iv: "db6c17ca00e79dd0570b58b291d73033"
server_key_version: "encryptionkey@0"
I20260811 00:50:54.037985 9289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:54.038807 9320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.039018 9289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:54.039108 9289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "024f434293cf48ca8e9fbc471c3ca0af"
format_stamp: "Formatted at 2026-08-11 00:50:54 on dist-test-slave-xt4k"
server_key: "24c8eba91534ab36299e8316b4bd2873"
server_key_iv: "db6c17ca00e79dd0570b58b291d73033"
server_key_version: "encryptionkey@0"
I20260811 00:50:54.039171 9289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:54.054905 9289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:54.057072 9289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:54.057210 9289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:54.057744 9289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:54.057785 9289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.057813 9289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:54.057837 9289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.064834 9289 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39701
I20260811 00:50:54.064888 9536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39701 every 8 connection(s)
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409454, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:54.065245 9289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:54.067898 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.058157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:55885 (local address 127.26.99.190:39277)
0811 00:50:54.058206 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.058208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.058420 (+ 212us) server_negotiation.cc:407] Connection header received
0811 00:50:54.058935 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.058936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.058948 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.059003 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:54.059744 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.060620 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.062259 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.062590 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.062657 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.065404 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:54.065406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:54.065406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:54.065414 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:54.066610 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.066979 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.066980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.066981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.067041 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.067266 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.067267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.067267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.067385 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:54.067442 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.067712 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.067808 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:50:54.068053 9337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.058154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.131:55885)
0811 00:50:54.058302 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.058337 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.058840 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.059069 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.059072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.059354 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:54.059634 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.059640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.060717 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.060719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.062074 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.062077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.062732 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.062734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.062877 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.063452 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:54.063472 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:54.065318 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:54.066685 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.066692 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.066694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.066906 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.067096 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.067097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.067097 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.067204 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.067448 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:54.067455 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:54.067588 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.067679 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.067837 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260811 00:50:54.068531 9537 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39277
I20260811 00:50:54.068620 9537 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:54.068796 9537 heartbeater.cc:511] Master 127.26.99.190:39277 requested a full tablet report, sending...
I20260811 00:50:54.069183 8618 ts_manager.cc:194] Registered new tserver with Master: 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:54.069665 8618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:55885
I20260811 00:50:54.072783 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 9289
I20260811 00:50:54.072887 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:54.073087 27022 external_mini_cluster.cc:1428] Setting key 0ee2c1833f1e811c03b4a93c9e970259
I20260811 00:50:54.073848 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:50:54.074759 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.069574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:43999 (local address 127.26.99.190:39277)
0811 00:50:54.069799 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.069801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.069809 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:54.069825 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.069826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.069835 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.069878 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:54.070214 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.070677 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.071352 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.071551 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.071604 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.072376 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:54.072377 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:54.072377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:54.072383 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:54.073710 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.074061 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.074062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.074062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.074119 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.074282 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.074283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.074283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.074388 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:54.074457 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.074591 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.074665 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207}
I20260811 00:50:54.074774 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.069487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.26.99.131:43999)
0811 00:50:54.069609 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.069619 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.069670 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.069897 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.069898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.070080 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:54.070143 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.070144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.070764 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.070765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.071283 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.071285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.071609 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.071610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.071674 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.072009 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:54.072012 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:54.072278 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:54.073790 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.073791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.073791 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.073998 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.074173 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.074174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.074174 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.074233 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.074455 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:54.074456 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:54.074503 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.074563 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.074668 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409454, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:50:54.095602 8714 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:54.090348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36202 (local address 127.26.99.190:39277)
0811 00:50:54.090395 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.090397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.090408 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:54.090482 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.090483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.090494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.090538 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:54.091075 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.091574 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.092291 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.092535 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.092591 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.095518 (+ 2927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36202: BlockingRecv error: recv got EOF from 127.0.0.1:36202 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409454, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:54.102525 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.096364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36214 (local address 127.26.99.190:39277)
0811 00:50:54.096412 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.096414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.096457 (+ 43us) server_negotiation.cc:407] Connection header received
0811 00:50:54.096524 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.096524 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.096532 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.096571 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:54.096962 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.097418 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.098083 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.098270 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.098331 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.100282 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:54.100284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:54.100284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:54.100290 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:54.101534 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.101843 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.101844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.101844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.101897 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.102114 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.102114 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.102115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.102207 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:54.102276 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.102399 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.102460 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:54.103957 8618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:54.105691 8618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:54.111826 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.107913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.0.0.1:46210)
0811 00:50:54.108208 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.108250 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.108316 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.108625 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.108628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.108630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.108713 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.108715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.109688 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.109689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.110573 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.110606 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.111507 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.111507 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.111593 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.111610 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.111689 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.111743 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":2,"thread_start_us":99,"threads_started":1}
I20260811 00:50:54.112170 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.108277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46210 (local address 127.26.99.130:41099)
0811 00:50:54.108471 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.108475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.108485 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:50:54.108524 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.108526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.108543 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.108621 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.108902 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.109609 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.110695 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.111433 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.111504 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.111575 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.112029 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.112075 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":95,"threads_started":1}
I20260811 00:50:54.112520 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.107916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:40865 (local address 127.0.0.1:44158)
0811 00:50:54.108461 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.108470 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.108518 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.108725 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.108726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.108727 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.108758 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.108759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.110443 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.110444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.111325 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.111328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.112234 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.112235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.112303 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.112308 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.112404 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.112448 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260811 00:50:54.112555 9583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.108111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44158 (local address 127.26.99.129:40865)
0811 00:50:54.108270 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.108275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.108522 (+ 247us) server_negotiation.cc:407] Connection header received
0811 00:50:54.108574 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.108576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.108590 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.108660 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.108813 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.110352 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.111406 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.112150 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.112222 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.112301 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.112416 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.112461 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260811 00:50:54.112892 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.108193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36530 (local address 127.26.99.131:39701)
0811 00:50:54.108399 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.108404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.108470 (+ 66us) server_negotiation.cc:407] Connection header received
0811 00:50:54.108591 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.108594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.108610 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.108673 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.108858 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.110312 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.111661 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.112266 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.112330 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.112451 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.112762 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.112806 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":82,"threads_started":1}
I20260811 00:50:54.112700 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.107916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39701 (local address 127.0.0.1:36530)
0811 00:50:54.108405 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.108416 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.108481 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.108746 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.108747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.108750 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.108797 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.108798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.110413 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.110414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.111598 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.111601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.112482 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.112483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.112539 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.112542 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.112601 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.112639 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":31,"thread_start_us":90,"threads_started":1}
I20260811 00:50:54.113027 9136 tablet_service.cc:1467] Processing CreateTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f (DEFAULT_TABLE table=test-table [id=2e7c3c45974940b89b9719ad873445ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.113472 9136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb39cb3921bf4f14b6f79a6c32d42e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.113591 8870 tablet_service.cc:1467] Processing CreateTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f (DEFAULT_TABLE table=test-table [id=2e7c3c45974940b89b9719ad873445ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.113631 9397 tablet_service.cc:1467] Processing CreateTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f (DEFAULT_TABLE table=test-table [id=2e7c3c45974940b89b9719ad873445ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.113948 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb39cb3921bf4f14b6f79a6c32d42e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.113927 8870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb39cb3921bf4f14b6f79a6c32d42e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.116844 9591 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Bootstrap starting.
I20260811 00:50:54.117425 9591 tablet_bootstrap.cc:654] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.117614 9592 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Bootstrap starting.
I20260811 00:50:54.117869 9591 log.cc:824] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:54.118203 9592 tablet_bootstrap.cc:654] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.118490 9592 log.cc:824] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:54.118686 9591 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: No bootstrap required, opened a new log
I20260811 00:50:54.118762 9591 ts_tablet_manager.cc:1397] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:54.118839 9596 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Bootstrap starting.
I20260811 00:50:54.119230 9592 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: No bootstrap required, opened a new log
I20260811 00:50:54.119298 9592 ts_tablet_manager.cc:1397] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:54.119412 9596 tablet_bootstrap.cc:654] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.119737 9596 log.cc:824] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:54.120549 9596 tablet_bootstrap.cc:492] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: No bootstrap required, opened a new log
I20260811 00:50:54.120633 9596 ts_tablet_manager.cc:1397] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:50:54.120873 9591 raft_consensus.cc:348] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.121044 9591 raft_consensus.cc:374] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.121096 9591 raft_consensus.cc:729] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.121207 9591 consensus_queue.cc:260] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.121150 9592 raft_consensus.cc:348] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.121289 9592 raft_consensus.cc:374] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.121327 9592 raft_consensus.cc:729] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.121446 9592 consensus_queue.cc:260] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.121486 9591 ts_tablet_manager.cc:1428] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:50:54.121699 9592 ts_tablet_manager.cc:1428] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:50:54.121701 9537 heartbeater.cc:503] Master 127.26.99.190:39277 was elected leader, sending a full tablet report...
I20260811 00:50:54.121729 9269 heartbeater.cc:503] Master 127.26.99.190:39277 was elected leader, sending a full tablet report...
I20260811 00:50:54.122752 9596 raft_consensus.cc:348] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.122869 9596 raft_consensus.cc:374] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.122888 9596 raft_consensus.cc:729] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740987ba96374a29a44537b48172a825, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.122993 9596 consensus_queue.cc:260] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.123231 9596 ts_tablet_manager.cc:1428] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:50:54.123296 8989 heartbeater.cc:503] Master 127.26.99.190:39277 was elected leader, sending a full tablet report...
W20260811 00:50:54.160667 9270 tablet.cc:2369] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:54.258180 8990 tablet.cc:2369] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:50:54.315930 9538 tablet.cc:2369] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:50:54.392205 9600 raft_consensus.cc:482] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:54.392330 9600 raft_consensus.cc:504] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.392704 9600 leader_election.cc:288] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099)
I20260811 00:50:54.396523 9583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.392997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:38011 (local address 127.26.99.129:40865)
0811 00:50:54.393065 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.393067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.393200 (+ 133us) server_negotiation.cc:407] Connection header received
0811 00:50:54.393243 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.393244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.393253 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.393306 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.393415 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.394100 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.395470 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.396070 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.396143 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.396153 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.396399 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.396460 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:50:54.396531 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.392953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:55799 (local address 127.26.99.130:41099)
0811 00:50:54.392999 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.393001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.393014 (+ 13us) server_negotiation.cc:407] Connection header received
0811 00:50:54.393065 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.393066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.393075 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.393126 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.393286 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.394055 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.395489 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.396060 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.396148 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.396156 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.396399 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.396445 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:54.396541 9605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.392880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:40865 (local address 127.26.99.131:38011)
0811 00:50:54.393132 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.393140 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.393193 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.393313 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.393313 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.393315 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.393364 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.393365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.394162 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.394162 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.395389 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.395392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.396195 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.396195 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.396283 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.396288 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.396389 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.396437 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":109,"thread_start_us":106,"threads_started":1}
I20260811 00:50:54.396554 9337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.392880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.26.99.131:55799)
0811 00:50:54.392938 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.392950 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.392993 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.393141 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.393142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.393144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.393219 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.393221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.394133 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.394134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.395389 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.395392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.396194 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.396195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.396286 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.396288 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.396389 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.396436 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":6}
I20260811 00:50:54.397014 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb39cb3921bf4f14b6f79a6c32d42e4f" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" is_pre_election: true
I20260811 00:50:54.397022 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb39cb3921bf4f14b6f79a6c32d42e4f" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825" is_pre_election: true
I20260811 00:50:54.397159 8905 raft_consensus.cc:2454] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 0.
I20260811 00:50:54.397161 9174 raft_consensus.cc:2454] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 0.
I20260811 00:50:54.397387 9323 leader_election.cc:302] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:54.397527 9600 raft_consensus.cc:2781] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:54.397585 9600 raft_consensus.cc:482] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:54.397600 9600 raft_consensus.cc:3037] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.398562 9600 raft_consensus.cc:504] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.398689 9600 leader_election.cc:288] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 election: Requested vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099)
I20260811 00:50:54.398851 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb39cb3921bf4f14b6f79a6c32d42e4f" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825"
I20260811 00:50:54.398861 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb39cb3921bf4f14b6f79a6c32d42e4f" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
I20260811 00:50:54.398926 8905 raft_consensus.cc:3037] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.398939 9174 raft_consensus.cc:3037] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.399573 8905 raft_consensus.cc:2454] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 1.
I20260811 00:50:54.399688 9174 raft_consensus.cc:2454] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 1.
I20260811 00:50:54.399734 9323 leader_election.cc:302] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:54.399827 9600 raft_consensus.cc:2781] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:54.399981 9600 raft_consensus.cc:686] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 1 LEADER]: Becoming Leader. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Running, Role: LEADER
I20260811 00:50:54.400081 9600 consensus_queue.cc:237] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.400986 8616 catalog_manager.cc:5495] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af reported cstate change: term changed from 0 to 1, leader changed from <none> to 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131). New cstate: current_term: 1 leader_uuid: "024f434293cf48ca8e9fbc471c3ca0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } health_report { overall_health: HEALTHY } } }
I20260811 00:50:54.464599 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.462201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36538 (local address 127.26.99.131:39701)
0811 00:50:54.462255 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.462257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.462265 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:54.462348 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.462349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.462389 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.462454 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:54.462626 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.463122 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.463892 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.464118 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.464171 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.464319 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.464433 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.464488 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.464515 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.464537 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:50:54.466390 8905 raft_consensus.cc:1261] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Refusing update from remote peer 024f434293cf48ca8e9fbc471c3ca0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.466418 9174 raft_consensus.cc:1261] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Refusing update from remote peer 024f434293cf48ca8e9fbc471c3ca0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.466749 9607 consensus_queue.cc:1035] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.466876 9600 consensus_queue.cc:1035] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.469801 9610 mvcc.cc:205] Tried to move back new op lower bound from 7317133125491625984 to 7317133125223280640. Current Snapshot: MvccSnapshot[applied={T|T < 7317133125491625984 or (T in {7317133125491625984})}]
I20260811 00:50:54.470006 9611 mvcc.cc:205] Tried to move back new op lower bound from 7317133125491625984 to 7317133125223280640. Current Snapshot: MvccSnapshot[applied={T|T < 7317133125491625984}]
I20260811 00:50:54.471225 8617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:54.471308 8617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:54.472412 8617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Sending DeleteTablet for 3 replicas of tablet bb39cb3921bf4f14b6f79a6c32d42e4f
I20260811 00:50:54.472739 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36530
I20260811 00:50:54.472982 9631 tablet_replica.cc:330] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: stopping tablet replica
I20260811 00:50:54.472998 8870 tablet_service.cc:1514] Processing DeleteTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44158
I20260811 00:50:54.472990 9136 tablet_service.cc:1514] Processing DeleteTablet for tablet bb39cb3921bf4f14b6f79a6c32d42e4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46210
I20260811 00:50:54.473176 9631 raft_consensus.cc:2229] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:54.473254 9634 tablet_replica.cc:330] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: stopping tablet replica
I20260811 00:50:54.473315 9631 raft_consensus.cc:2258] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.473469 9634 raft_consensus.cc:2229] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:54.473443 8617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:54.473578 8617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:54.473582 9634 raft_consensus.cc:2258] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.473707 9636 tablet_replica.cc:330] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: stopping tablet replica
I20260811 00:50:54.473879 9636 raft_consensus.cc:2229] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:54.474028 9636 raft_consensus.cc:2258] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.474097 9631 ts_tablet_manager.cc:1905] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.474457 9634 ts_tablet_manager.cc:1905] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.475575 9136 tablet_service.cc:1467] Processing CreateTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 (DEFAULT_TABLE table=test-table [id=707f831ce5684b9d85983fa56d65efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.475674 9136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad6238fea3c4416fa1661dc4e74031e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.475934 9631 ts_tablet_manager.cc:1918] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:54.476007 9631 log.cc:1196] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/bb39cb3921bf4f14b6f79a6c32d42e4f
I20260811 00:50:54.476094 9634 ts_tablet_manager.cc:1918] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:54.476157 9634 log.cc:1196] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/bb39cb3921bf4f14b6f79a6c32d42e4f
I20260811 00:50:54.476259 9631 ts_tablet_manager.cc:1939] T bb39cb3921bf4f14b6f79a6c32d42e4f P 024f434293cf48ca8e9fbc471c3ca0af: Deleting consensus metadata
I20260811 00:50:54.476419 9634 ts_tablet_manager.cc:1939] T bb39cb3921bf4f14b6f79a6c32d42e4f P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting consensus metadata
I20260811 00:50:54.476661 8586 catalog_manager.cc:4841] TS 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701): tablet bb39cb3921bf4f14b6f79a6c32d42e4f (table test-table [id=2e7c3c45974940b89b9719ad873445ff]) successfully deleted
I20260811 00:50:54.476904 9592 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Bootstrap starting.
I20260811 00:50:54.477252 8870 tablet_service.cc:1467] Processing CreateTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 (DEFAULT_TABLE table=test-table [id=707f831ce5684b9d85983fa56d65efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.477365 8870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad6238fea3c4416fa1661dc4e74031e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.477375 9592 tablet_bootstrap.cc:654] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.478008 9592 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: No bootstrap required, opened a new log
I20260811 00:50:54.478048 9592 ts_tablet_manager.cc:1397] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:54.478386 9592 raft_consensus.cc:348] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.478461 9592 raft_consensus.cc:374] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.478482 9592 raft_consensus.cc:729] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.478528 9592 consensus_queue.cc:260] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.478624 9596 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Bootstrap starting.
I20260811 00:50:54.478632 9592 ts_tablet_manager.cc:1428] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:54.479000 9596 tablet_bootstrap.cc:654] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.479082 9397 tablet_service.cc:1467] Processing CreateTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 (DEFAULT_TABLE table=test-table [id=707f831ce5684b9d85983fa56d65efe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:54.479195 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad6238fea3c4416fa1661dc4e74031e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.479640 9596 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: No bootstrap required, opened a new log
I20260811 00:50:54.479692 9596 ts_tablet_manager.cc:1397] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:54.479841 9596 raft_consensus.cc:348] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.479913 9596 raft_consensus.cc:374] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.479933 9596 raft_consensus.cc:729] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740987ba96374a29a44537b48172a825, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.479971 9596 consensus_queue.cc:260] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.480082 9596 ts_tablet_manager.cc:1428] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.480301 9591 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Bootstrap starting.
I20260811 00:50:54.480507 8594 catalog_manager.cc:4841] TS 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099): tablet bb39cb3921bf4f14b6f79a6c32d42e4f (table test-table [id=2e7c3c45974940b89b9719ad873445ff]) successfully deleted
I20260811 00:50:54.480749 9591 tablet_bootstrap.cc:654] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.481426 9591 tablet_bootstrap.cc:492] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: No bootstrap required, opened a new log
I20260811 00:50:54.481473 9591 ts_tablet_manager.cc:1397] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:54.481621 9591 raft_consensus.cc:348] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.481681 9591 raft_consensus.cc:374] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.481681 9636 ts_tablet_manager.cc:1905] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.481700 9591 raft_consensus.cc:729] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.481747 9591 consensus_queue.cc:260] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.481835 9591 ts_tablet_manager.cc:1428] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.483242 9636 ts_tablet_manager.cc:1918] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:54.483314 9636 log.cc:1196] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/bb39cb3921bf4f14b6f79a6c32d42e4f
I20260811 00:50:54.483827 9636 ts_tablet_manager.cc:1939] T bb39cb3921bf4f14b6f79a6c32d42e4f P 740987ba96374a29a44537b48172a825: Deleting consensus metadata
I20260811 00:50:54.484179 8589 catalog_manager.cc:4841] TS 740987ba96374a29a44537b48172a825 (127.26.99.129:40865): tablet bb39cb3921bf4f14b6f79a6c32d42e4f (table test-table [id=2e7c3c45974940b89b9719ad873445ff]) successfully deleted
I20260811 00:50:54.821061 9603 raft_consensus.cc:482] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:54.821173 9603 raft_consensus.cc:504] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.821544 9603 leader_election.cc:288] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:54.825642 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.821890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:52743 (local address 127.26.99.131:39701)
0811 00:50:54.821939 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.821941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.822010 (+ 69us) server_negotiation.cc:407] Connection header received
0811 00:50:54.822052 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.822053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.822066 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.822119 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.822290 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.823068 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.824730 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.825280 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.825350 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.825359 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.825529 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.825568 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:50:54.825642 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.821823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:52395 (local address 127.26.99.130:41099)
0811 00:50:54.821876 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.821879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.821976 (+ 97us) server_negotiation.cc:407] Connection header received
0811 00:50:54.822051 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.822052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.822066 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.822119 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.822300 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.823059 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.824730 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.825274 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.825350 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.825359 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.825529 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.825569 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:54.825697 9644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.821738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.26.99.129:52395)
0811 00:50:54.821885 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.821894 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.821976 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.822133 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.822133 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.822134 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.822240 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.822242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.823162 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.823163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.824630 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.824633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.825378 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.825380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.825448 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.825454 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.825515 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.825568 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":134,"thread_start_us":85,"threads_started":1}
I20260811 00:50:54.825696 9645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.821835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39701 (local address 127.26.99.129:52743)
0811 00:50:54.821943 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.821952 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.822005 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.822131 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.822132 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.822134 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.822225 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.822227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.823185 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.823186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.824630 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.824633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.825378 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.825380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.825463 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.825466 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.825515 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.825568 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":62,"thread_start_us":51,"threads_started":1}
I20260811 00:50:54.825960 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad6238fea3c4416fa1661dc4e74031e6" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" is_pre_election: true
I20260811 00:50:54.826056 9174 raft_consensus.cc:2454] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 0.
I20260811 00:50:54.826150 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad6238fea3c4416fa1661dc4e74031e6" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af" is_pre_election: true
I20260811 00:50:54.826263 9415 raft_consensus.cc:2454] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 0.
I20260811 00:50:54.826243 8789 leader_election.cc:302] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aaa7ea07024f2f9ea6b7a54b7e80f6, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:54.826378 9603 raft_consensus.cc:2781] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:54.826426 9603 raft_consensus.cc:482] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:54.826443 9603 raft_consensus.cc:3037] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.827116 9603 raft_consensus.cc:504] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.827231 9603 leader_election.cc:288] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 election: Requested vote from peers 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:54.827407 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad6238fea3c4416fa1661dc4e74031e6" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
I20260811 00:50:54.827494 9174 raft_consensus.cc:3037] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.828100 9174 raft_consensus.cc:2454] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 1.
I20260811 00:50:54.828279 8789 leader_election.cc:302] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aaa7ea07024f2f9ea6b7a54b7e80f6, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:54.828267 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad6238fea3c4416fa1661dc4e74031e6" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af"
I20260811 00:50:54.828366 9415 raft_consensus.cc:3037] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.828382 9603 raft_consensus.cc:2781] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:54.828562 9603 raft_consensus.cc:686] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 1 LEADER]: Becoming Leader. State: Replica: 740987ba96374a29a44537b48172a825, State: Running, Role: LEADER
I20260811 00:50:54.828639 9603 consensus_queue.cc:237] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.829264 9415 raft_consensus.cc:2454] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 1.
I20260811 00:50:54.829409 8616 catalog_manager.cc:5495] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 740987ba96374a29a44537b48172a825 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "740987ba96374a29a44537b48172a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } health_report { overall_health: UNKNOWN } } }
Aug 11 00:50:54 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409453, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.190@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:54.851634 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.845024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39277 (local address 127.0.0.1:60908)
0811 00:50:54.845183 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.845196 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.845260 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.845418 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.845419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.845751 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:54.845805 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.845808 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.846462 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.846463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.847038 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.847040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.847320 (+ 280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.847321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.847356 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.847862 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:54.847867 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:54.849249 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:54.850754 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.850761 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.850762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.850960 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.851110 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:54.851111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:54.851111 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:54.851161 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:54.851348 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:54.851352 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:54.851392 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.851434 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.851538 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260811 00:50:54.851692 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.845106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60908 (local address 127.26.99.190:39277)
0811 00:50:54.845266 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.845268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.845279 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:54.845301 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.845301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.845312 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.845381 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:54.845874 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.846368 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.847099 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.847275 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.847315 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.849327 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:54.849329 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:54.849329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:54.849335 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:54.850682 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.851017 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.851018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.851018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.851067 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:54.851200 (+ 133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:54.851201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:54.851201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:54.851308 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:54.851354 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.851457 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.851586 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260811 00:50:54.853502 8616 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:60908:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 00:50:54.853721 8616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:54.855090 8870 tablet_service.cc:1467] Processing CreateTablet for tablet a825ceb857274a8ba5b3b44bdb98297e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4dfe709a52b46ddae0e1c98a7f9f910]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:54.855096 9397 tablet_service.cc:1467] Processing CreateTablet for tablet a825ceb857274a8ba5b3b44bdb98297e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4dfe709a52b46ddae0e1c98a7f9f910]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:54.855242 8870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a825ceb857274a8ba5b3b44bdb98297e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.855242 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a825ceb857274a8ba5b3b44bdb98297e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.856379 9591 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: Bootstrap starting.
I20260811 00:50:54.856634 9136 tablet_service.cc:1467] Processing CreateTablet for tablet a825ceb857274a8ba5b3b44bdb98297e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a4dfe709a52b46ddae0e1c98a7f9f910]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 00:50:54.856690 9596 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: Bootstrap starting.
I20260811 00:50:54.856734 9591 tablet_bootstrap.cc:654] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.856781 9136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a825ceb857274a8ba5b3b44bdb98297e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:54.857062 9596 tablet_bootstrap.cc:654] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.857262 9591 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: No bootstrap required, opened a new log
I20260811 00:50:54.857297 9591 ts_tablet_manager.cc:1397] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:54.857412 9591 raft_consensus.cc:348] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.857478 9591 raft_consensus.cc:374] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.857497 9591 raft_consensus.cc:729] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.857545 9591 consensus_queue.cc:260] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.857679 9591 ts_tablet_manager.cc:1428] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.857743 9596 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: No bootstrap required, opened a new log
I20260811 00:50:54.857704 9621 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.857782 9596 ts_tablet_manager.cc:1397] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:54.857795 9621 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.857897 9596 raft_consensus.cc:348] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.857939 9596 raft_consensus.cc:374] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.857950 9596 raft_consensus.cc:729] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740987ba96374a29a44537b48172a825, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.857985 9596 consensus_queue.cc:260] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.858044 9596 ts_tablet_manager.cc:1428] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.858282 9592 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Bootstrap starting.
I20260811 00:50:54.858405 9603 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.858484 9603 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.858669 9592 tablet_bootstrap.cc:654] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:54.859357 9592 tablet_bootstrap.cc:492] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: No bootstrap required, opened a new log
I20260811 00:50:54.859408 9592 ts_tablet_manager.cc:1397] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:54.859534 9592 raft_consensus.cc:348] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.859597 9592 raft_consensus.cc:374] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:54.859611 9592 raft_consensus.cc:729] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Initialized, Role: FOLLOWER
I20260811 00:50:54.859652 9592 consensus_queue.cc:260] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.859740 9592 ts_tablet_manager.cc:1428] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:54.859809 9602 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.859908 9602 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.927105 9602 raft_consensus.cc:482] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:54.927196 9602 raft_consensus.cc:504] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.927517 9602 leader_election.cc:288] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:54.930488 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.927785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:38475 (local address 127.26.99.131:39701)
0811 00:50:54.927832 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.927834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.927959 (+ 125us) server_negotiation.cc:407] Connection header received
0811 00:50:54.928093 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.928095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.928106 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.928159 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.928298 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.928794 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.929831 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.930194 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.930256 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.930265 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.930378 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.930414 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:50:54.930488 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.927745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:53685 (local address 127.26.99.129:40865)
0811 00:50:54.927905 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.927907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.927958 (+ 51us) server_negotiation.cc:407] Connection header received
0811 00:50:54.928017 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.928018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.928030 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.928088 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:50:54.928245 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.928798 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.929829 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.930198 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.930260 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.930268 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.930381 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.930417 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":59,"threads_started":1}
I20260811 00:50:54.930507 9675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.927691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39701 (local address 127.26.99.130:38475)
0811 00:50:54.927887 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.927898 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.927991 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.928160 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.928161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.928162 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.928189 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.928190 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.928869 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.928870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.929745 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.929748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.930261 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.930262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.930318 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.930321 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.930365 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.930406 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":47,"thread_start_us":118,"threads_started":1}
I20260811 00:50:54.930516 9677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.927683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:40865 (local address 127.26.99.130:53685)
0811 00:50:54.927874 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.927885 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.927955 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.928107 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.928107 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.928109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:50:54.928164 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.928166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.928899 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.928900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.929743 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.929745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.930266 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.930266 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.930325 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.930328 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.930371 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.930412 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":29,"thread_start_us":122,"threads_started":1}
I20260811 00:50:54.930696 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a825ceb857274a8ba5b3b44bdb98297e" candidate_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af" is_pre_election: true
I20260811 00:50:54.930784 9415 raft_consensus.cc:2454] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aaa7ea07024f2f9ea6b7a54b7e80f6 in term 0.
I20260811 00:50:54.930966 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a825ceb857274a8ba5b3b44bdb98297e" candidate_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825" is_pre_election: true
I20260811 00:50:54.931048 8905 raft_consensus.cc:2454] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aaa7ea07024f2f9ea6b7a54b7e80f6 in term 0.
I20260811 00:50:54.931021 9045 leader_election.cc:302] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 32aaa7ea07024f2f9ea6b7a54b7e80f6; no voters:
I20260811 00:50:54.931136 9602 raft_consensus.cc:2781] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:54.931180 9602 raft_consensus.cc:482] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:54.931196 9602 raft_consensus.cc:3037] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.931979 9602 raft_consensus.cc:504] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.932104 9602 leader_election.cc:288] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [CANDIDATE]: Term 1 election: Requested vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:54.932268 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a825ceb857274a8ba5b3b44bdb98297e" candidate_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825"
I20260811 00:50:54.932283 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a825ceb857274a8ba5b3b44bdb98297e" candidate_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af"
I20260811 00:50:54.932370 8905 raft_consensus.cc:3037] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.932374 9415 raft_consensus.cc:3037] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:54.933104 8905 raft_consensus.cc:2454] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aaa7ea07024f2f9ea6b7a54b7e80f6 in term 1.
I20260811 00:50:54.933156 9415 raft_consensus.cc:2454] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aaa7ea07024f2f9ea6b7a54b7e80f6 in term 1.
I20260811 00:50:54.933282 9046 leader_election.cc:302] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aaa7ea07024f2f9ea6b7a54b7e80f6, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:54.933382 9602 raft_consensus.cc:2781] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:54.933521 9602 raft_consensus.cc:686] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 LEADER]: Becoming Leader. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Running, Role: LEADER
I20260811 00:50:54.933581 9602 consensus_queue.cc:237] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:54.934073 9681 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: TxnStatusTablet state changed. Reason: New leader 32aaa7ea07024f2f9ea6b7a54b7e80f6. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.934155 9681 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:54.934333 9685 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 00:50:54.934265 8617 catalog_manager.cc:5495] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:54.934453 9685 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 00:50:54.951126 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.948834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45554 (local address 127.26.99.130:41099)
0811 00:50:54.948877 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.948878 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.948905 (+ 27us) server_negotiation.cc:407] Connection header received
0811 00:50:54.948996 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.948997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.949016 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.949070 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:54.949191 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.949680 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.950419 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.950607 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.950659 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.950824 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.950915 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.950976 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.951038 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.951057 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:54.951149 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.948756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.0.0.1:45554)
0811 00:50:54.948848 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.948862 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.948927 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.949081 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.949082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.949083 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:54.949134 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.949136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.949761 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.949762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.950352 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.950354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.950663 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.950664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.950730 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.950747 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.950969 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.950978 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.951032 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.951085 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 00:50:54.952114 8905 raft_consensus.cc:1261] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Refusing update from remote peer 32aaa7ea07024f2f9ea6b7a54b7e80f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.952237 9415 raft_consensus.cc:1261] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Refusing update from remote peer 32aaa7ea07024f2f9ea6b7a54b7e80f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.952373 9681 consensus_queue.cc:1035] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.952590 9681 consensus_queue.cc:1035] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.953264 9603 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: TxnStatusTablet state changed. Reason: New leader 32aaa7ea07024f2f9ea6b7a54b7e80f6. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.953354 9603 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.953914 9621 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: TxnStatusTablet state changed. Reason: New leader 32aaa7ea07024f2f9ea6b7a54b7e80f6. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.954011 9621 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.954559 9602 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.954639 9602 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:54.954689 9602 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.954725 9602 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 32aaa7ea07024f2f9ea6b7a54b7e80f6: This TxnStatusTablet replica's current role is: LEADER
I20260811 00:50:54.954886 9615 mvcc.cc:205] Tried to move back new op lower bound from 7317133127482114048 to 7317133127408529408. Current Snapshot: MvccSnapshot[applied={T|T < 7317133127482114048}]
I20260811 00:50:54.955014 9603 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.955090 9603 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 740987ba96374a29a44537b48172a825: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.955713 9621 tablet_replica.cc:439] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } } }
I20260811 00:50:54.955796 9621 tablet_replica.cc:442] T a825ceb857274a8ba5b3b44bdb98297e P 024f434293cf48ca8e9fbc471c3ca0af: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 00:50:54.958608 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.956049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.26.99.129:40865)
0811 00:50:54.956218 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.956220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.956227 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:54.956258 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.956259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.956277 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.956373 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:54.956502 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.956944 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.957963 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.958151 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.958196 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.958339 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.958432 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.958478 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.958535 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.958555 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260811 00:50:54.964208 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.961016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:56103 (local address 127.26.99.130:41099)
0811 00:50:54.961077 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.961079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.961166 (+ 87us) server_negotiation.cc:407] Connection header received
0811 00:50:54.961250 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.961251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.961259 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.961302 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:54.961433 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.961912 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.963573 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.963766 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.963818 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.963989 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.964012 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.964043 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.964131 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.964148 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:50:54.964277 9693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.960939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.26.99.129:56103)
0811 00:50:54.961109 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.961120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.961194 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.961306 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.961307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.961308 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:54.961374 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.961375 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.961977 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.961978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.963500 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.963503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.963830 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.963831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.963895 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.963913 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.964056 (+ 143us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.964057 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.964122 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.964163 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260811 00:50:54.966465 9174 raft_consensus.cc:1261] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Refusing update from remote peer 740987ba96374a29a44537b48172a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.966490 9415 raft_consensus.cc:1261] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Refusing update from remote peer 740987ba96374a29a44537b48172a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:54.966739 9646 consensus_queue.cc:1035] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.966858 9603 consensus_queue.cc:1035] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:54.979272 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.972575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:51791 (local address 127.26.99.129:40865)
0811 00:50:54.972612 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:54.972614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:54.976540 (+ 3926us) server_negotiation.cc:407] Connection header received
0811 00:50:54.976625 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:54.976626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:54.976637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:54.976682 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:54.977017 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.977757 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.978552 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.978832 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.978899 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.979050 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.979084 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.979131 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:54.979171 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 00:50:54.979192 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:50:54.979297 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:54.972540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:40865 (local address 127.26.99.130:51791)
0811 00:50:54.976464 (+ 3924us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:54.976475 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:54.976570 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:54.976683 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:54.976684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:54.976685 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:54.976758 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.976760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.977827 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.977828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.978460 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:54.978462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:54.978906 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:54.978907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:54.978962 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:54.978977 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:54.979131 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:54.979132 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:54.979161 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 00:50:54.979209 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3887,"thread_start_us":75,"threads_started":1}
I20260811 00:50:54.988786 8617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:54.988893 8617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:54.989499 8617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Sending DeleteTablet for 3 replicas of tablet ad6238fea3c4416fa1661dc4e74031e6
I20260811 00:50:54.989748 8870 tablet_service.cc:1514] Processing DeleteTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44158
I20260811 00:50:54.989786 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36530
I20260811 00:50:54.990098 9136 tablet_service.cc:1514] Processing DeleteTablet for tablet ad6238fea3c4416fa1661dc4e74031e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:54 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46210
I20260811 00:50:54.990262 9715 tablet_replica.cc:330] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: stopping tablet replica
I20260811 00:50:54.990345 9715 raft_consensus.cc:2229] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:54.990411 9715 raft_consensus.cc:2258] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.990365 9711 tablet_replica.cc:330] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: stopping tablet replica
I20260811 00:50:54.990552 9711 raft_consensus.cc:2229] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:54.990425 9713 tablet_replica.cc:330] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: stopping tablet replica
I20260811 00:50:54.990685 9713 raft_consensus.cc:2229] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:54.990711 9715 ts_tablet_manager.cc:1905] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.990784 9711 raft_consensus.cc:2258] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.990914 9713 raft_consensus.cc:2258] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:54.991225 9711 ts_tablet_manager.cc:1905] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.991509 9713 ts_tablet_manager.cc:1905] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:54.992479 9715 ts_tablet_manager.cc:1918] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:54.992610 9715 log.cc:1196] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/ad6238fea3c4416fa1661dc4e74031e6
I20260811 00:50:54.992897 9715 ts_tablet_manager.cc:1939] T ad6238fea3c4416fa1661dc4e74031e6 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting consensus metadata
I20260811 00:50:54.993269 8594 catalog_manager.cc:4841] TS 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099): tablet ad6238fea3c4416fa1661dc4e74031e6 (table test-table [id=707f831ce5684b9d85983fa56d65efe6]) successfully deleted
I20260811 00:50:54.994385 9713 ts_tablet_manager.cc:1918] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:54.994439 9713 log.cc:1196] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/ad6238fea3c4416fa1661dc4e74031e6
I20260811 00:50:54.994632 9713 ts_tablet_manager.cc:1939] T ad6238fea3c4416fa1661dc4e74031e6 P 740987ba96374a29a44537b48172a825: Deleting consensus metadata
I20260811 00:50:54.994911 9711 ts_tablet_manager.cc:1918] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:54.994931 8589 catalog_manager.cc:4841] TS 740987ba96374a29a44537b48172a825 (127.26.99.129:40865): tablet ad6238fea3c4416fa1661dc4e74031e6 (table test-table [id=707f831ce5684b9d85983fa56d65efe6]) successfully deleted
I20260811 00:50:54.995052 9711 log.cc:1196] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/ad6238fea3c4416fa1661dc4e74031e6
I20260811 00:50:54.995263 9711 ts_tablet_manager.cc:1939] T ad6238fea3c4416fa1661dc4e74031e6 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting consensus metadata
I20260811 00:50:54.995538 8586 catalog_manager.cc:4841] TS 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701): tablet ad6238fea3c4416fa1661dc4e74031e6 (table test-table [id=707f831ce5684b9d85983fa56d65efe6]) successfully deleted
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[8530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:50:55.017216 9663 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:55.011845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.26.99.190:39277)
0811 00:50:55.011912 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.011915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.012004 (+ 89us) server_negotiation.cc:407] Connection header received
0811 00:50:55.012072 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.012072 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.012084 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.012130 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:55.012716 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.013289 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.014123 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.014367 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.014428 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.017162 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60916: BlockingRecv error: recv got EOF from 127.0.0.1:60916 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[8530](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM
I20260811 00:50:55.025300 9663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.018364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.26.99.190:39277)
0811 00:50:55.018402 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.018413 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.018424 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:55.018497 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.018498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.018507 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.018548 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:55.018982 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.019555 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.020522 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.020733 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.020791 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.022908 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:55.022910 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:55.022910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:55.022918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:55.024214 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:55.024574 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:55.024576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:55.024576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:55.024630 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:55.024798 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:55.024799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:55.024799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:55.024920 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:55.025015 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:55.025111 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 00:50:55.025202 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:50:55.026937 8617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:55.027109 8617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:55.028508 9136 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (DEFAULT_TABLE table=test-table [id=d18f3b5c20014037bc21a14ef9af0533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.028522 8870 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (DEFAULT_TABLE table=test-table [id=d18f3b5c20014037bc21a14ef9af0533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.028654 8870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.028654 9136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.030026 9592 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Bootstrap starting.
I20260811 00:50:55.030076 9596 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Bootstrap starting.
I20260811 00:50:55.030417 9592 tablet_bootstrap.cc:654] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.030552 9596 tablet_bootstrap.cc:654] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.031213 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (DEFAULT_TABLE table=test-table [id=d18f3b5c20014037bc21a14ef9af0533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.031330 9592 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: No bootstrap required, opened a new log
I20260811 00:50:55.031344 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.031373 9592 ts_tablet_manager.cc:1397] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:55.031530 9592 raft_consensus.cc:348] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.031600 9592 raft_consensus.cc:374] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.031616 9592 raft_consensus.cc:729] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.031654 9592 consensus_queue.cc:260] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.031729 9592 ts_tablet_manager.cc:1428] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 00:50:55.032863 9591 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Bootstrap starting.
I20260811 00:50:55.032903 9596 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: No bootstrap required, opened a new log
I20260811 00:50:55.032946 9596 ts_tablet_manager.cc:1397] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 00:50:55.033106 9596 raft_consensus.cc:348] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.033174 9596 raft_consensus.cc:374] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.033195 9596 raft_consensus.cc:729] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740987ba96374a29a44537b48172a825, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.033243 9596 consensus_queue.cc:260] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.033272 9591 tablet_bootstrap.cc:654] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.033334 9596 ts_tablet_manager.cc:1428] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:55.034328 9591 tablet_bootstrap.cc:492] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: No bootstrap required, opened a new log
I20260811 00:50:55.034394 9591 ts_tablet_manager.cc:1397] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260811 00:50:55.034505 9591 raft_consensus.cc:348] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.034562 9591 raft_consensus.cc:374] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.034579 9591 raft_consensus.cc:729] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.034621 9591 consensus_queue.cc:260] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.034785 9591 ts_tablet_manager.cc:1428] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:55.099287 9707 raft_consensus.cc:482] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:55.099407 9707 raft_consensus.cc:504] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.099603 9707 leader_election.cc:288] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:55.099830 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce18c8cf5194ee09e9b6bb5db0040a0" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" is_pre_election: true
I20260811 00:50:55.099833 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce18c8cf5194ee09e9b6bb5db0040a0" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af" is_pre_election: true
I20260811 00:50:55.099921 9415 raft_consensus.cc:2454] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 0.
I20260811 00:50:55.099921 9174 raft_consensus.cc:2454] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 0.
I20260811 00:50:55.100096 8780 leader_election.cc:302] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 32aaa7ea07024f2f9ea6b7a54b7e80f6, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:55.100184 9707 raft_consensus.cc:2781] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:55.100211 9707 raft_consensus.cc:482] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:55.100226 9707 raft_consensus.cc:3037] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.101022 9707 raft_consensus.cc:504] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.101146 9707 leader_election.cc:288] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 election: Requested vote from peers 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099), 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701)
I20260811 00:50:55.101279 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce18c8cf5194ee09e9b6bb5db0040a0" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
I20260811 00:50:55.101312 9415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ce18c8cf5194ee09e9b6bb5db0040a0" candidate_uuid: "740987ba96374a29a44537b48172a825" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024f434293cf48ca8e9fbc471c3ca0af"
I20260811 00:50:55.101344 9174 raft_consensus.cc:3037] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.101372 9415 raft_consensus.cc:3037] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.102113 9174 raft_consensus.cc:2454] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 1.
I20260811 00:50:55.102114 9415 raft_consensus.cc:2454] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 740987ba96374a29a44537b48172a825 in term 1.
I20260811 00:50:55.102279 8789 leader_election.cc:302] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aaa7ea07024f2f9ea6b7a54b7e80f6, 740987ba96374a29a44537b48172a825; no voters:
I20260811 00:50:55.102399 9707 raft_consensus.cc:2781] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:55.102442 9707 raft_consensus.cc:686] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 1 LEADER]: Becoming Leader. State: Replica: 740987ba96374a29a44537b48172a825, State: Running, Role: LEADER
I20260811 00:50:55.102484 9707 consensus_queue.cc:237] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.103076 8616 catalog_manager.cc:5495] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 reported cstate change: term changed from 0 to 1, leader changed from <none> to 740987ba96374a29a44537b48172a825 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "740987ba96374a29a44537b48172a825" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } health_report { overall_health: UNKNOWN } } }
I20260811 00:50:55.110308 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.108140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35722 (local address 127.26.99.129:40865)
0811 00:50:55.108178 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.108180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.108191 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:55.108266 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.108266 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.108276 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.108316 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:55.108479 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.108961 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.109690 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.109896 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.109949 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.110095 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.110131 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.110174 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:55.110223 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 00:50:55.110243 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:50:55.110999 9174 raft_consensus.cc:1261] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Refusing update from remote peer 740987ba96374a29a44537b48172a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:55.110999 9415 raft_consensus.cc:1261] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Refusing update from remote peer 740987ba96374a29a44537b48172a825: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:55.111207 9701 consensus_queue.cc:1035] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:55.111294 9707 consensus_queue.cc:1035] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:55.115131 8617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:55.115227 8617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:55.115913 8617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Sending DeleteTablet for 3 replicas of tablet 4ce18c8cf5194ee09e9b6bb5db0040a0
I20260811 00:50:55.116129 9136 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46210
I20260811 00:50:55.116252 9135 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46210
I20260811 00:50:55.116374 9715 tablet_replica.cc:330] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: stopping tablet replica
I20260811 00:50:55.116467 9715 raft_consensus.cc:2229] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:55.116469 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36530
I20260811 00:50:55.116520 9715 raft_consensus.cc:2258] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.116554 9711 tablet_replica.cc:330] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: stopping tablet replica
I20260811 00:50:55.116605 9711 raft_consensus.cc:2229] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:55.116652 9711 raft_consensus.cc:2258] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.116945 8870 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44158
I20260811 00:50:55.116904 8617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:50:55.117076 8617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:50:55.117125 9715 ts_tablet_manager.cc:1905] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.117231 9713 tablet_replica.cc:330] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: stopping tablet replica
I20260811 00:50:55.117295 9713 raft_consensus.cc:2229] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:55.117357 9713 raft_consensus.cc:2258] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.117640 9713 ts_tablet_manager.cc:1905] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.118577 9135 tablet_service.cc:1467] Processing CreateTablet for tablet 773902eece044c7790070fe5507f7036 (DEFAULT_TABLE table=test-table [id=a089742b36e44ee3ab31e9d4897b06d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.118716 9135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773902eece044c7790070fe5507f7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.118719 9715 ts_tablet_manager.cc:1918] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:55.119134 9715 log.cc:1196] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/4ce18c8cf5194ee09e9b6bb5db0040a0
I20260811 00:50:55.119187 9713 ts_tablet_manager.cc:1918] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:55.119239 9713 log.cc:1196] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/4ce18c8cf5194ee09e9b6bb5db0040a0
I20260811 00:50:55.119378 9715 ts_tablet_manager.cc:1939] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting consensus metadata
I20260811 00:50:55.119441 9713 ts_tablet_manager.cc:1939] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 740987ba96374a29a44537b48172a825: Deleting consensus metadata
I20260811 00:50:55.119616 8870 tablet_service.cc:1467] Processing CreateTablet for tablet 773902eece044c7790070fe5507f7036 (DEFAULT_TABLE table=test-table [id=a089742b36e44ee3ab31e9d4897b06d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.119693 8870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773902eece044c7790070fe5507f7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.119921 9592 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Bootstrap starting.
I20260811 00:50:55.119923 9711 ts_tablet_manager.cc:1905] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.120224 9592 tablet_bootstrap.cc:654] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.120589 9397 tablet_service.cc:1467] Processing CreateTablet for tablet 773902eece044c7790070fe5507f7036 (DEFAULT_TABLE table=test-table [id=a089742b36e44ee3ab31e9d4897b06d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:50:55.120692 9397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773902eece044c7790070fe5507f7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:55.120851 9596 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: Bootstrap starting.
I20260811 00:50:55.121280 9596 tablet_bootstrap.cc:654] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.121649 9711 ts_tablet_manager.cc:1918] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:50:55.121701 9711 log.cc:1196] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/4ce18c8cf5194ee09e9b6bb5db0040a0
I20260811 00:50:55.121913 9711 ts_tablet_manager.cc:1939] T 4ce18c8cf5194ee09e9b6bb5db0040a0 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting consensus metadata
I20260811 00:50:55.122082 9591 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Bootstrap starting.
I20260811 00:50:55.122082 8589 catalog_manager.cc:4841] TS 740987ba96374a29a44537b48172a825 (127.26.99.129:40865): tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (table test-table [id=d18f3b5c20014037bc21a14ef9af0533]) successfully deleted
I20260811 00:50:55.122279 8586 catalog_manager.cc:4841] TS 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701): tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (table test-table [id=d18f3b5c20014037bc21a14ef9af0533]) successfully deleted
I20260811 00:50:55.122365 9591 tablet_bootstrap.cc:654] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:55.122570 8594 catalog_manager.cc:4841] TS 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099): tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 (table test-table [id=d18f3b5c20014037bc21a14ef9af0533]) successfully deleted
W20260811 00:50:55.122689 8594 catalog_manager.cc:4808] TS 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099): delete failed for tablet 4ce18c8cf5194ee09e9b6bb5db0040a0 because the tablet was not found. No further retry: Not found: Tablet not found: 4ce18c8cf5194ee09e9b6bb5db0040a0
I20260811 00:50:55.122924 9596 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: No bootstrap required, opened a new log
I20260811 00:50:55.122975 9596 ts_tablet_manager.cc:1397] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:50:55.123104 9596 raft_consensus.cc:348] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123171 9596 raft_consensus.cc:374] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.123189 9596 raft_consensus.cc:729] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 740987ba96374a29a44537b48172a825, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.123231 9596 consensus_queue.cc:260] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123293 9592 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: No bootstrap required, opened a new log
I20260811 00:50:55.123308 9591 tablet_bootstrap.cc:492] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: No bootstrap required, opened a new log
I20260811 00:50:55.123315 9596 ts_tablet_manager.cc:1428] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:55.123332 9592 ts_tablet_manager.cc:1397] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 00:50:55.123350 9591 ts_tablet_manager.cc:1397] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:55.123445 9592 raft_consensus.cc:348] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123494 9592 raft_consensus.cc:374] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.123508 9592 raft_consensus.cc:729] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aaa7ea07024f2f9ea6b7a54b7e80f6, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.123461 9591 raft_consensus.cc:348] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123522 9591 raft_consensus.cc:374] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:55.123541 9591 raft_consensus.cc:729] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Initialized, Role: FOLLOWER
I20260811 00:50:55.123543 9592 consensus_queue.cc:260] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123582 9591 consensus_queue.cc:260] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.123621 9592 ts_tablet_manager.cc:1428] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:55.123663 9591 ts_tablet_manager.cc:1428] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:55.397460 9621 raft_consensus.cc:482] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:50:55.397588 9621 raft_consensus.cc:504] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.397778 9621 leader_election.cc:288] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099)
I20260811 00:50:55.398049 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773902eece044c7790070fe5507f7036" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" is_pre_election: true
I20260811 00:50:55.398146 9174 raft_consensus.cc:2454] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 0.
I20260811 00:50:55.398102 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773902eece044c7790070fe5507f7036" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825" is_pre_election: true
I20260811 00:50:55.398226 8905 raft_consensus.cc:2454] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 0.
I20260811 00:50:55.398341 9328 leader_election.cc:302] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 32aaa7ea07024f2f9ea6b7a54b7e80f6; no voters:
I20260811 00:50:55.398453 9621 raft_consensus.cc:2781] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:50:55.398514 9621 raft_consensus.cc:482] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:50:55.398537 9621 raft_consensus.cc:3037] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.399250 9621 raft_consensus.cc:504] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.399361 9621 leader_election.cc:288] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 election: Requested vote from peers 740987ba96374a29a44537b48172a825 (127.26.99.129:40865), 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099)
I20260811 00:50:55.399555 9174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773902eece044c7790070fe5507f7036" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6"
I20260811 00:50:55.399627 9174 raft_consensus.cc:3037] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.399585 8905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773902eece044c7790070fe5507f7036" candidate_uuid: "024f434293cf48ca8e9fbc471c3ca0af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "740987ba96374a29a44537b48172a825"
I20260811 00:50:55.399660 8905 raft_consensus.cc:3037] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:55.400202 9174 raft_consensus.cc:2454] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 1.
I20260811 00:50:55.400389 9328 leader_election.cc:302] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024f434293cf48ca8e9fbc471c3ca0af, 32aaa7ea07024f2f9ea6b7a54b7e80f6; no voters:
I20260811 00:50:55.400422 8905 raft_consensus.cc:2454] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024f434293cf48ca8e9fbc471c3ca0af in term 1.
I20260811 00:50:55.400506 9621 raft_consensus.cc:2781] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:55.400632 9621 raft_consensus.cc:686] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 LEADER]: Becoming Leader. State: Replica: 024f434293cf48ca8e9fbc471c3ca0af, State: Running, Role: LEADER
I20260811 00:50:55.400681 9621 consensus_queue.cc:237] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } }
I20260811 00:50:55.401235 8616 catalog_manager.cc:5495] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af reported cstate change: term changed from 0 to 1, leader changed from <none> to 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131). New cstate: current_term: 1 leader_uuid: "024f434293cf48ca8e9fbc471c3ca0af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024f434293cf48ca8e9fbc471c3ca0af" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39701 } health_report { overall_health: HEALTHY } } }
I20260811 00:50:55.409945 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.408030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55422 (local address 127.26.99.131:39701)
0811 00:50:55.408076 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.408078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.408086 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:50:55.408138 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.408139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.408148 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.408185 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:55.408272 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.408795 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.409465 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.409652 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.409696 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.409780 (+ 84us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.409804 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.409832 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:55.409870 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 00:50:55.409884 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:50:55.414144 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.412063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:46445 (local address 127.26.99.130:41099)
0811 00:50:55.412115 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.412117 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.412226 (+ 109us) server_negotiation.cc:407] Connection header received
0811 00:50:55.412266 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.412267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.412275 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.412318 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:55.412436 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.412884 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.413625 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.413799 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.413846 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.413990 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.414014 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.414042 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:55.414078 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 00:50:55.414094 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:50:55.414160 9763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.412012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:41099 (local address 127.26.99.131:46445)
0811 00:50:55.412164 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:55.412173 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:55.412228 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:55.412324 (+ 96us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:55.412325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:55.412326 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:55.412388 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:55.412389 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.412933 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.412933 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:55.413548 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:55.413550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.413859 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.413860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:55.413911 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.413927 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.414048 (+ 121us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.414049 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:55.414076 (+ 27us) client_negotiation.cc:240] Negotiation successful
0811 00:50:55.414109 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260811 00:50:55.415920 9174 raft_consensus.cc:1261] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Refusing update from remote peer 024f434293cf48ca8e9fbc471c3ca0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:55.415920 8905 raft_consensus.cc:1261] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Refusing update from remote peer 024f434293cf48ca8e9fbc471c3ca0af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:50:55.416118 9756 consensus_queue.cc:1035] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "740987ba96374a29a44537b48172a825" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 40865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:55.416229 9621 consensus_queue.cc:1035] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aaa7ea07024f2f9ea6b7a54b7e80f6" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 41099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:50:55.422318 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.420308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39701 (local address 127.26.99.130:48009)
0811 00:50:55.420385 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:55.420395 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:55.420438 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:55.420557 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:55.420558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:55.420559 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 00:50:55.420599 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:55.420601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.421130 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.421131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:55.421656 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:55.421657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.421988 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.421989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:55.422045 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.422052 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.422194 (+ 142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.422195 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 00:50:55.422232 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 00:50:55.422268 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 00:50:55.422320 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.420362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:48009 (local address 127.26.99.131:39701)
0811 00:50:55.420395 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:55.420397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:55.420424 (+ 27us) server_negotiation.cc:407] Connection header received
0811 00:50:55.420496 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:55.420497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:55.420507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:55.420556 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:50:55.420646 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.421079 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.421728 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:55.421919 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:55.421978 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:55.422108 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:50:55.422140 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:50:55.422188 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:55.422236 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:50:55.422257 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:50:55.428442 8618 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:55.428522 8618 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:50:55.429056 8618 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5386be974f384d4c8bdde429482955f0: Sending DeleteTablet for 3 replicas of tablet 773902eece044c7790070fe5507f7036
I20260811 00:50:55.429280 9397 tablet_service.cc:1514] Processing DeleteTablet for tablet 773902eece044c7790070fe5507f7036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36530
I20260811 00:50:55.429281 9135 tablet_service.cc:1514] Processing DeleteTablet for tablet 773902eece044c7790070fe5507f7036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46210
I20260811 00:50:55.429363 9715 tablet_replica.cc:330] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: stopping tablet replica
I20260811 00:50:55.429363 9711 tablet_replica.cc:330] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: stopping tablet replica
I20260811 00:50:55.429337 8870 tablet_service.cc:1514] Processing DeleteTablet for tablet 773902eece044c7790070fe5507f7036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:50:55 UTC) from {username='oryx', principal='oryx/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44158
I20260811 00:50:55.429409 9711 raft_consensus.cc:2229] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:50:55.429409 9715 raft_consensus.cc:2229] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:55.429425 9713 tablet_replica.cc:330] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: stopping tablet replica
I20260811 00:50:55.429440 9715 raft_consensus.cc:2258] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.429457 9711 raft_consensus.cc:2258] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.429473 9713 raft_consensus.cc:2229] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:50:55.429504 9713 raft_consensus.cc:2258] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:50:55.429785 9711 ts_tablet_manager.cc:1905] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.429795 9715 ts_tablet_manager.cc:1905] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.429890 9713 ts_tablet_manager.cc:1905] T 773902eece044c7790070fe5507f7036 P 740987ba96374a29a44537b48172a825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:50:55.431058 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 8755
I20260811 00:50:55.439337 9711 ts_tablet_manager.cc:1918] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:55.439415 9711 log.cc:1196] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/773902eece044c7790070fe5507f7036
I20260811 00:50:55.439486 9715 ts_tablet_manager.cc:1918] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 00:50:55.439540 9715 log.cc:1196] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/773902eece044c7790070fe5507f7036
I20260811 00:50:55.439625 9711 ts_tablet_manager.cc:1939] T 773902eece044c7790070fe5507f7036 P 024f434293cf48ca8e9fbc471c3ca0af: Deleting consensus metadata
I20260811 00:50:55.439719 9715 ts_tablet_manager.cc:1939] T 773902eece044c7790070fe5507f7036 P 32aaa7ea07024f2f9ea6b7a54b7e80f6: Deleting consensus metadata
I20260811 00:50:55.440012 8586 catalog_manager.cc:4841] TS 024f434293cf48ca8e9fbc471c3ca0af (127.26.99.131:39701): tablet 773902eece044c7790070fe5507f7036 (table test-table [id=a089742b36e44ee3ab31e9d4897b06d1]) successfully deleted
I20260811 00:50:55.440029 8594 catalog_manager.cc:4841] TS 32aaa7ea07024f2f9ea6b7a54b7e80f6 (127.26.99.130:41099): tablet 773902eece044c7790070fe5507f7036 (table test-table [id=a089742b36e44ee3ab31e9d4897b06d1]) successfully deleted
W20260811 00:50:55.445575 8589 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:40865 (error 108)
I20260811 00:50:55.445922 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 9007
I20260811 00:50:55.447817 9775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:55.445962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:40865 (local address 127.0.0.1:35728)
0811 00:50:55.447735 (+ 1773us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:55.447784 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:40865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1751,"thread_start_us":70,"threads_started":1}
W20260811 00:50:55.447924 8589 catalog_manager.cc:4584] TS 740987ba96374a29a44537b48172a825 (127.26.99.129:40865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 773902eece044c7790070fe5507f7036: Network error: Client connection negotiation failed: client connection to 127.26.99.129:40865: connect: Connection refused (error 111)
I20260811 00:50:55.460394 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 9289
I20260811 00:50:55.473610 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 8557
2026-08-11T00:50:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3330 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[9781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[9781](info): set up 2 sockets
Aug 11 00:50:55 dist-test-slave-xt4k krb5kdc[9781](info): commencing operation
krb5kdc: starting...
W20260811 00:50:56.675132 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:56 dist-test-slave-xt4k krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:56.786775 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37545
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:41673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:56.867578 9804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:56.867769 9804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:56.867787 9804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:56.868878 9804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:56.868913 9804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:56.868927 9804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:56.868937 9804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:56.868948 9804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:56.870375 9804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:41673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:56.870563 9804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:56.870735 9804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:56.875526 9815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:56.875620 9804 server_base.cc:1034] running on GCE node
W20260811 00:50:56.875531 9809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:56.875504 9811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:56.875936 9804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:56.876191 9804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:56.877336 9804 hybrid_clock.cc:648] HybridClock initialized: now 1786409456877321 us; error 33 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T00:50:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1411 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:50:56 dist-test-slave-xt4k krb5kdc[9822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:50:56 dist-test-slave-xt4k krb5kdc[9822](info): set up 2 sockets
Aug 11 00:50:56 dist-test-slave-xt4k krb5kdc[9822](info): commencing operation
krb5kdc: starting...
W20260811 00:50:58.089021 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:50:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:50:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:50:58.206650 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33159
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:58.288226 9853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:58.288457 9853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:58.288480 9853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:58.289629 9853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:58.289670 9853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:58.289682 9853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:58.289696 9853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:58.289719 9853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:58.291224 9853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:58.291456 9853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:58.291667 9853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:58.296257 9861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.296265 9860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:58.296362 9853 server_base.cc:1034] running on GCE node
W20260811 00:50:58.296265 9865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:58.296702 9853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:58.296991 9853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:58.298143 9853 hybrid_clock.cc:648] HybridClock initialized: now 1786409458298127 us; error 32 us; skew 500 ppm
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:58.300485 9853 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:58.300928 9853 webserver.cc:460] Webserver started at http://127.26.99.190:40293/ using document root <none> and password file <none>
I20260811 00:50:58.301143 9853 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:58.301192 9853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:58.301329 9853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:58.302325 9853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "1239ef725bf54ae8a1be5ebc9446c36e"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "2bdaa2ccbc97d5289d6f60eed0aced53"
server_key_iv: "e151d9f2db7541eac68765c6a0cb2447"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.302639 9853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "1239ef725bf54ae8a1be5ebc9446c36e"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "2bdaa2ccbc97d5289d6f60eed0aced53"
server_key_iv: "e151d9f2db7541eac68765c6a0cb2447"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.303776 9853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:50:58.304388 9878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.304531 9853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:58.304631 9853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "1239ef725bf54ae8a1be5ebc9446c36e"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "2bdaa2ccbc97d5289d6f60eed0aced53"
server_key_iv: "e151d9f2db7541eac68765c6a0cb2447"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.304685 9853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:58.318856 9853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:58.320890 9853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:58.320997 9853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:58.324681 9853 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:33159
I20260811 00:50:58.324731 9964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:33159 every 8 connection(s)
I20260811 00:50:58.325047 9853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:58.325938 9966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:50:58.328226 9966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Bootstrap starting.
I20260811 00:50:58.328933 9966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Neither blocks nor log segments found. Creating new log.
I20260811 00:50:58.329228 9966 log.cc:824] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:58.329887 9966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: No bootstrap required, opened a new log
I20260811 00:50:58.331485 9966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:58.331653 9966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:50:58.331701 9966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1239ef725bf54ae8a1be5ebc9446c36e, State: Initialized, Role: FOLLOWER
I20260811 00:50:58.331858 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 9853
I20260811 00:50:58.331847 9966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:58.331926 9966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:58.331954 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:50:58.331972 9966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:58.332024 9966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:50:58.332173 27022 external_mini_cluster.cc:1428] Setting key 01f088e696bdff02b7454ac4fa86c779
I20260811 00:50:58.332717 9966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:58.332909 9966 leader_election.cc:302] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1239ef725bf54ae8a1be5ebc9446c36e; no voters:
I20260811 00:50:58.333076 9966 leader_election.cc:288] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:50:58.333276 9978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:50:58.333328 9966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:58.333464 9978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 LEADER]: Becoming Leader. State: Replica: 1239ef725bf54ae8a1be5ebc9446c36e, State: Running, Role: LEADER
I20260811 00:50:58.333581 9978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:58.333915 9978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1239ef725bf54ae8a1be5ebc9446c36e. Latest consensus state: current_term: 1 leader_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } } }
I20260811 00:50:58.334034 9978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:58.333925 9979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } } }
I20260811 00:50:58.335021 9979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: This master's current role is: LEADER
W20260811 00:50:58.335538 9999 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:50:58.335594 9999 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:50:58.335638 9990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:58.335829 9990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:58.337421 9990 catalog_manager.cc:1347] Generated new cluster ID: 9b858b32dd53402fbd5db746a1577298
I20260811 00:50:58.337473 9990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:58.349957 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.332672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60830 (local address 127.26.99.190:33159)
0811 00:50:58.332850 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:58.332860 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:58.332888 (+ 28us) server_negotiation.cc:407] Connection header received
0811 00:50:58.333004 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:58.333011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:58.333069 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:58.333213 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:58.334173 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.335590 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.336698 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.337308 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.337418 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.346429 (+ 9011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:58.346434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:58.346435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:58.346448 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:58.348308 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.348727 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.348730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.348730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.348841 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.349017 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.349018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.349018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.349339 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:58.349469 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:58.349570 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 00:50:58.349714 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260811 00:50:58.353350 9990 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:50:58.354313 9990 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:58.357517 9990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Generated new TSK 0
I20260811 00:50:58.357687 9990 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:50:58.383737 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:58.464694 10009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:58.464887 10009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:58.464917 10009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:58.466077 10009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:58.466117 10009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:58.466152 10009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:58.467588 10009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:58.467823 10009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:58.468039 10009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:58.472812 10014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.472831 10017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.472822 10020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:58.473028 10009 server_base.cc:1034] running on GCE node
I20260811 00:50:58.473205 10009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:58.473438 10009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:58.474573 10009 hybrid_clock.cc:648] HybridClock initialized: now 1786409458474558 us; error 34 us; skew 500 ppm
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:58.477008 10009 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:50:58.477434 10009 webserver.cc:460] Webserver started at http://127.26.99.129:44131/ using document root <none> and password file <none>
I20260811 00:50:58.477639 10009 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:58.477679 10009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:58.477770 10009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:58.478754 10009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "826ff408efe14decbd8134a393ca2f27"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "e998add5763337264b2b12e84cc3a7fd"
server_key_iv: "649c3b784467a6e6609fb067411d5505"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.479046 10009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "826ff408efe14decbd8134a393ca2f27"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "e998add5763337264b2b12e84cc3a7fd"
server_key_iv: "649c3b784467a6e6609fb067411d5505"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.480206 10009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:50:58.480943 10032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.481127 10009 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:58.481220 10009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "826ff408efe14decbd8134a393ca2f27"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "e998add5763337264b2b12e84cc3a7fd"
server_key_iv: "649c3b784467a6e6609fb067411d5505"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.481280 10009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:58.498484 10009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:58.500576 10009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:58.500710 10009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:58.500912 10009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:58.501204 10009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:58.501236 10009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.501264 10009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:58.501287 10009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.506747 10009 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:46081
I20260811 00:50:58.506846 10222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:46081 every 8 connection(s)
I20260811 00:50:58.507118 10009 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:58.509078 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 10009
I20260811 00:50:58.509162 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:50:58.509336 27022 external_mini_cluster.cc:1428] Setting key c3b287ff5c191d0c610138c266e98dd7
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:58.516825 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.507859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:56317 (local address 127.26.99.190:33159)
0811 00:50:58.507913 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:58.507915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:58.508132 (+ 217us) server_negotiation.cc:407] Connection header received
0811 00:50:58.508661 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:58.508662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:58.508677 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:58.508738 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:58.509743 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.510317 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.511278 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.511552 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.511619 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.513849 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:58.513851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:58.513852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:58.513860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:58.515421 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.515832 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.515833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.515834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.515898 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.516178 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.516179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.516179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.516318 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:58.516410 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:58.516647 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 00:50:58.516733 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:50:58.516927 10229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.507836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:56317)
0811 00:50:58.507993 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:58.508035 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:58.508574 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:58.508789 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:58.508792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:58.509383 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:58.509657 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.509663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.510401 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.510403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.511194 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.511197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.511645 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.511647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.511768 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.512204 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:58.512211 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:58.513749 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:58.515534 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.515541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.515542 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.515764 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.515986 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.515987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.515987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.516109 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.516397 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:58.516402 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:58.516524 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 00:50:58.516609 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:50:58.516749 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260811 00:50:58.517431 10225 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33159
I20260811 00:50:58.517520 10225 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:58.517694 10225 heartbeater.cc:511] Master 127.26.99.190:33159 requested a full tablet report, sending...
I20260811 00:50:58.518213 9905 ts_manager.cc:194] Registered new tserver with Master: 826ff408efe14decbd8134a393ca2f27 (127.26.99.129:46081)
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
I20260811 00:50:58.518819 9905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:56317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:50:58.535637 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:58.616493 10232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:58.616684 10232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:58.616706 10232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:58.617798 10232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:58.617831 10232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:58.617856 10232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:58.619243 10232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:58.619449 10232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:58.619620 10232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:58.624298 10241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.624289 10239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.624325 10237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:58.624398 10232 server_base.cc:1034] running on GCE node
I20260811 00:50:58.624790 10232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:58.625029 10232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:58.626169 10232 hybrid_clock.cc:648] HybridClock initialized: now 1786409458626159 us; error 32 us; skew 500 ppm
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:58.628577 10232 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:50:58.629012 10232 webserver.cc:460] Webserver started at http://127.26.99.130:38751/ using document root <none> and password file <none>
I20260811 00:50:58.629238 10232 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:58.629287 10232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:58.629413 10232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:58.630381 10232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "72d9455f29f64999a2662da7efa30d36"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "d77c919ffb8df7be656466684eb1b44c"
server_key_iv: "4dcd682e21da527ea09ea9823f7c8e53"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.630712 10232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "72d9455f29f64999a2662da7efa30d36"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "d77c919ffb8df7be656466684eb1b44c"
server_key_iv: "4dcd682e21da527ea09ea9823f7c8e53"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.632009 10232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:50:58.632700 10253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.632884 10232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.632975 10232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "72d9455f29f64999a2662da7efa30d36"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "d77c919ffb8df7be656466684eb1b44c"
server_key_iv: "4dcd682e21da527ea09ea9823f7c8e53"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.633038 10232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:58.654842 10232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:58.656894 10232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:58.657042 10232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:58.657265 10232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:58.657572 10232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:58.657608 10232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.657637 10232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:58.657661 10232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.663264 10232 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39455
I20260811 00:50:58.663324 10480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39455 every 8 connection(s)
I20260811 00:50:58.663705 10232 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:58.670704 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 10232
I20260811 00:50:58.670805 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:50:58.670987 27022 external_mini_cluster.cc:1428] Setting key fd56bbb5d1a7dd944f4e4c42649b9e66
I20260811 00:50:58.672190 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.664397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:32975 (local address 127.26.99.190:33159)
0811 00:50:58.664456 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:58.664458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:58.664636 (+ 178us) server_negotiation.cc:407] Connection header received
0811 00:50:58.665138 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:58.665139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:58.665152 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:58.665205 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:58.666132 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.666631 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.667595 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.667791 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.667849 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.669885 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:58.669886 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:58.669886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:58.669894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:58.670964 (+ 1070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.671315 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.671316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.671316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.671372 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.671596 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.671597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.671597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.671708 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:58.671769 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:58.672017 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 00:50:58.672104 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:50:58.672369 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.664369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:32975)
0811 00:50:58.664519 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:58.664555 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:58.665037 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:58.665274 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:58.665277 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:58.665835 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:58.666032 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.666037 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.666715 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.666716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.667506 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.667508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.667859 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.667860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.667986 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.668456 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:58.668464 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:58.669792 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:58.671038 (+ 1246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.671045 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.671047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.671249 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.671426 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.671427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.671427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.671539 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.671762 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:58.671769 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:58.671899 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 00:50:58.671985 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:50:58.672138 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260811 00:50:58.672821 10482 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33159
I20260811 00:50:58.672923 10482 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:58.673115 10482 heartbeater.cc:511] Master 127.26.99.190:33159 requested a full tablet report, sending...
I20260811 00:50:58.673491 9905 ts_manager.cc:194] Registered new tserver with Master: 72d9455f29f64999a2662da7efa30d36 (127.26.99.130:39455)
I20260811 00:50:58.673846 9905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:32975
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:50:58.695808 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:58.776911 10487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:58.777141 10487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:58.777177 10487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:58.778352 10487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:58.778398 10487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:58.778434 10487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:58.779866 10487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:58.780104 10487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:58.780325 10487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:58.785841 10496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.785853 10495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:58.785887 10500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:58.785995 10487 server_base.cc:1034] running on GCE node
I20260811 00:50:58.786329 10487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:58.786546 10487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:58.787703 10487 hybrid_clock.cc:648] HybridClock initialized: now 1786409458787688 us; error 29 us; skew 500 ppm
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:58.790192 10487 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:50:58.790620 10487 webserver.cc:460] Webserver started at http://127.26.99.131:45343/ using document root <none> and password file <none>
I20260811 00:50:58.790823 10487 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:58.790871 10487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:58.790999 10487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:50:58.792034 10487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "9e887c91ccec4b35aa7266d4865cf924"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "f57e95ac51472dc556ef306c8cf610d9"
server_key_iv: "47d9457b09ee72b5dbe1c94476c8f000"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.792414 10487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "9e887c91ccec4b35aa7266d4865cf924"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "f57e95ac51472dc556ef306c8cf610d9"
server_key_iv: "47d9457b09ee72b5dbe1c94476c8f000"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.793659 10487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:58.794366 10518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.794516 10487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:50:58.794601 10487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "9e887c91ccec4b35aa7266d4865cf924"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "f57e95ac51472dc556ef306c8cf610d9"
server_key_iv: "47d9457b09ee72b5dbe1c94476c8f000"
server_key_version: "encryptionkey@0"
I20260811 00:50:58.794667 10487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:58.809031 10487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:58.811075 10487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:58.811204 10487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:58.811417 10487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:58.811714 10487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:58.811748 10487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.811777 10487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:58.811801 10487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:58.817590 10487 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38379
I20260811 00:50:58.817646 10729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38379 every 8 connection(s)
I20260811 00:50:58.817940 10487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:58.821034 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 10487
I20260811 00:50:58.821134 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:50:58.821328 27022 external_mini_cluster.cc:1428] Setting key df54bf867b6d07ef7cc51a46a6dc3af3
Aug 11 00:50:58 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409458, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:50:58.826973 9977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.818799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:41121 (local address 127.26.99.190:33159)
0811 00:50:58.818861 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:58.818863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:58.818927 (+ 64us) server_negotiation.cc:407] Connection header received
0811 00:50:58.819451 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:58.819453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:58.819463 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:58.819525 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:58.820464 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.821049 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.822339 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.822564 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.822621 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.824613 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:58.824614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:58.824615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:58.824622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:58.825730 (+ 1108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.826109 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.826110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.826110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.826166 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:58.826414 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:58.826414 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:58.826415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:58.826507 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:58.826553 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:58.826826 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 00:50:58.826901 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:50:58.827055 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:58.818625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:41121)
0811 00:50:58.818810 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:58.818855 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:58.819338 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:58.819587 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:58.819590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:58.820153 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:58.820373 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.820379 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.821129 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.821131 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.822185 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:58.822188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:58.822628 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:58.822629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:58.822729 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:58.823142 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:58.823150 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:58.824524 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:50:58.825813 (+ 1289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.825820 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.825821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.826042 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.826244 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:50:58.826245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:50:58.826246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:50:58.826357 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:50:58.826562 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:50:58.826565 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:50:58.826672 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 00:50:58.826764 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 00:50:58.826886 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260811 00:50:58.827476 10732 heartbeater.cc:347] Connected to a master server at 127.26.99.190:33159
I20260811 00:50:58.827569 10732 heartbeater.cc:464] Registering TS with master...
I20260811 00:50:58.827754 10732 heartbeater.cc:511] Master 127.26.99.190:33159 requested a full tablet report, sending...
I20260811 00:50:58.828099 9905 ts_manager.cc:194] Registered new tserver with Master: 9e887c91ccec4b35aa7266d4865cf924 (127.26.99.131:38379)
I20260811 00:50:58.828493 9905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:41121
I20260811 00:50:58.833096 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
Entry for principal oryx/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab.
WARNING: no policy specified for oryx/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
Entry for principal oryx/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab.
WARNING: no policy specified for oryx/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
Entry for principal oryx/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab.
I20260811 00:50:58.902464 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 10009
I20260811 00:50:58.946159 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 10232
I20260811 00:50:58.956291 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 10487
I20260811 00:50:58.963078 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 9853
I20260811 00:50:58.980418 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33159
--webserver_interface=127.26.99.190
--webserver_port=40293
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33159
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:50:59.060983 10749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:59.061167 10749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:59.061187 10749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:59.062294 10749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:50:59.062333 10749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:59.062346 10749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:59.062357 10749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:50:59.062368 10749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:50:59.063867 10749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:59.064072 10749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:59.064276 10749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:59.068783 10765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.068794 10757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.068840 10749 server_base.cc:1034] running on GCE node
W20260811 00:50:59.068800 10763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.069172 10749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:59.069433 10749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:59.070592 10749 hybrid_clock.cc:648] HybridClock initialized: now 1786409459070575 us; error 32 us; skew 500 ppm
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409459, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:59.072923 10749 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:50:59.073346 10749 webserver.cc:460] Webserver started at http://127.26.99.190:40293/ using document root <none> and password file <none>
I20260811 00:50:59.073559 10749 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:59.073624 10749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:59.074887 10749 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:59.075484 10774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.075634 10749 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.075718 10749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "1239ef725bf54ae8a1be5ebc9446c36e"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "2bdaa2ccbc97d5289d6f60eed0aced53"
server_key_iv: "e151d9f2db7541eac68765c6a0cb2447"
server_key_version: "encryptionkey@0"
I20260811 00:50:59.076035 10749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:59.100852 10749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:59.102885 10749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:59.103027 10749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:59.107043 10749 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:33159
I20260811 00:50:59.107072 10859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:33159 every 8 connection(s)
I20260811 00:50:59.107445 10749 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:50:59.108919 10862 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:50:59.109570 10862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Bootstrap starting.
I20260811 00:50:59.115377 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 10749
I20260811 00:50:59.115644 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:46081
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:33159
--webserver_port=44131
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:50:59.117720 10862 log.cc:824] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:50:59.119359 10862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:50:59.119625 10862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Bootstrap complete.
I20260811 00:50:59.121750 10862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:59.121973 10862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1239ef725bf54ae8a1be5ebc9446c36e, State: Initialized, Role: FOLLOWER
I20260811 00:50:59.122130 10862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:59.122210 10862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:50:59.122259 10862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:50:59.122308 10862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:50:59.123303 10862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:59.123399 10862 leader_election.cc:302] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1239ef725bf54ae8a1be5ebc9446c36e; no voters:
I20260811 00:50:59.123560 10862 leader_election.cc:288] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:50:59.123618 10868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:50:59.123777 10868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [term 2 LEADER]: Becoming Leader. State: Replica: 1239ef725bf54ae8a1be5ebc9446c36e, State: Running, Role: LEADER
I20260811 00:50:59.123839 10862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:50:59.123924 10868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } }
I20260811 00:50:59.124225 10871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1239ef725bf54ae8a1be5ebc9446c36e. Latest consensus state: current_term: 2 leader_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } } }
I20260811 00:50:59.124230 10869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1239ef725bf54ae8a1be5ebc9446c36e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33159 } } }
I20260811 00:50:59.124326 10871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:59.124353 10869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e [sys.catalog]: This master's current role is: LEADER
I20260811 00:50:59.124540 10877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:50:59.125098 10877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:50:59.125295 10877 catalog_manager.cc:1259] Loaded cluster ID: 9b858b32dd53402fbd5db746a1577298
I20260811 00:50:59.125520 10877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:50:59.126354 10877 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:50:59.126521 10877 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1239ef725bf54ae8a1be5ebc9446c36e: Loaded TSK: 0
I20260811 00:50:59.126715 10877 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:50:59.214187 10866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:59.214375 10866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:59.214397 10866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:59.215523 10866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:59.215564 10866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:59.215590 10866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:50:59.217033 10866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.129.keytab
--principal=oryx/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:46081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=44131
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:59.217240 10866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:59.217443 10866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:59.222211 10907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.222282 10908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.222506 10911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.222564 10866 server_base.cc:1034] running on GCE node
I20260811 00:50:59.222793 10866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:59.223053 10866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:59.224232 10866 hybrid_clock.cc:648] HybridClock initialized: now 1786409459224203 us; error 45 us; skew 500 ppm
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409459, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:59.227231 10866 init.cc:377] Logged in from keytab as oryx/127.26.99.129@KRBTEST.COM (short username oryx)
I20260811 00:50:59.227727 10866 webserver.cc:460] Webserver started at http://127.26.99.129:44131/ using document root <none> and password file <none>
I20260811 00:50:59.227964 10866 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:59.228042 10866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:59.229802 10866 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:59.230502 10925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.230669 10866 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:59.230759 10866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "826ff408efe14decbd8134a393ca2f27"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "e998add5763337264b2b12e84cc3a7fd"
server_key_iv: "649c3b784467a6e6609fb067411d5505"
server_key_version: "encryptionkey@0"
I20260811 00:50:59.231107 10866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:59.250723 10866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:59.252849 10866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:59.252976 10866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:59.253211 10866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:59.253518 10866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:59.253554 10866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.253583 10866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:59.253602 10866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.259195 10866 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:46081
I20260811 00:50:59.259256 11144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:46081 every 8 connection(s)
I20260811 00:50:59.259620 10866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:50:59.261515 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 10866
I20260811 00:50:59.261799 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:39455
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:33159
--webserver_port=38751
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.268802 11147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.260271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:38893)
0811 00:50:59.260465 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.260507 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.261096 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.261696 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.261700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.262428 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.262700 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.262706 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.264174 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.264175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.265141 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.265144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.265712 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.265714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.265841 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.266311 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.266322 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.268608 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
W20260811 00:50:59.268891 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.260391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:38893 (local address 127.26.99.190:33159)
0811 00:50:59.261277 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.261286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.261317 (+ 31us) server_negotiation.cc:407] Connection header received
0811 00:50:59.261430 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.261436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.261484 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.261601 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.262834 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.264059 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.265226 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.265629 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.265725 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.268743 (+ 3018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:38893: BlockingRecv error: recv got EOF from 127.26.99.129:38893 (error 108)
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":73,"threads_started":1}
W20260811 00:50:59.269026 11145 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:33159 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.99.190:33159: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.273639 11147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.269249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:49831)
0811 00:50:59.269367 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.269378 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.269433 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.269573 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.269573 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.269714 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.269766 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.269768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.270356 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.270358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.271114 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.271117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.271448 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.271449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.271513 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.271856 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.271861 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.273594 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98}
W20260811 00:50:59.273768 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.269316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:49831 (local address 127.26.99.190:33159)
0811 00:50:59.269361 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.269363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.269417 (+ 54us) server_negotiation.cc:407] Connection header received
0811 00:50:59.269487 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.269488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.269498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.269554 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.269842 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.270285 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.271198 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.271380 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.271430 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.273706 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:49831: BlockingRecv error: recv got EOF from 127.26.99.129:49831 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.277648 11147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.273940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:39459)
0811 00:50:59.273970 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.273980 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.274014 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.274136 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.274137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.274245 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.274269 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.274270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.274832 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.274833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.275299 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.275301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.275602 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.275603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.275654 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.275974 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.275979 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.277589 (+ 1610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 00:50:59.277777 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.273988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:39459 (local address 127.26.99.190:33159)
0811 00:50:59.274047 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.274049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.274056 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:59.274075 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.274075 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.274085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.274128 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.274330 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.274767 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.275367 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.275546 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.275599 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.277677 (+ 2078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:39459: BlockingRecv error: recv got EOF from 127.26.99.129:39459 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 00:50:59.277769 11145 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:50:59.348896 11153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:59.349098 11153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:59.349130 11153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:59.350584 11153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:59.350637 11153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:59.350689 11153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:50:59.352236 11153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.130.keytab
--principal=oryx/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:39455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=38751
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:59.352509 11153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:59.352732 11153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:59.357450 11167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.357558 11162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.357666 11153 server_base.cc:1034] running on GCE node
W20260811 00:50:59.357510 11169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.357944 11153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:59.358176 11153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:59.359335 11153 hybrid_clock.cc:648] HybridClock initialized: now 1786409459359314 us; error 48 us; skew 500 ppm
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409459, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:59.362066 11153 init.cc:377] Logged in from keytab as oryx/127.26.99.130@KRBTEST.COM (short username oryx)
I20260811 00:50:59.362524 11153 webserver.cc:460] Webserver started at http://127.26.99.130:38751/ using document root <none> and password file <none>
I20260811 00:50:59.362775 11153 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:59.362846 11153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:59.364275 11153 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:50:59.365057 11184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.365253 11153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:50:59.365351 11153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "72d9455f29f64999a2662da7efa30d36"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "d77c919ffb8df7be656466684eb1b44c"
server_key_iv: "4dcd682e21da527ea09ea9823f7c8e53"
server_key_version: "encryptionkey@0"
I20260811 00:50:59.365810 11153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:59.395936 11153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:59.398089 11153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:59.398233 11153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:59.398466 11153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:59.398888 11153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:59.398934 11153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.398965 11153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:59.398983 11153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.404717 11153 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39455
I20260811 00:50:59.404769 11382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39455 every 8 connection(s)
I20260811 00:50:59.405135 11153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:50:59.408305 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 11153
I20260811 00:50:59.408641 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:38379
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:33159
--webserver_port=45343
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:46537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 00:50:59.413931 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.405857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:51077 (local address 127.26.99.190:33159)
0811 00:50:59.405923 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.405926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.406142 (+ 216us) server_negotiation.cc:407] Connection header received
0811 00:50:59.406799 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.406800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.406815 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.406871 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.408119 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.408860 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.410369 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.410564 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.410631 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.413864 (+ 3233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:51077: BlockingRecv error: recv got EOF from 127.26.99.130:51077 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:50:59.413973 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.405832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:51077)
0811 00:50:59.406000 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.406048 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.406674 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.406958 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.406963 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.407705 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.407989 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.407995 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.408953 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.408954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.410247 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.410251 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.410651 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.410652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.410791 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.411286 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.411296 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.413762 (+ 2466us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
W20260811 00:50:59.414479 11385 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:33159 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.99.190:33159: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.419873 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.414807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:59455)
0811 00:50:59.414851 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.414861 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.414895 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.415049 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.415049 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.415197 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.415249 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.415251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.416096 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.416098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.416920 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.416923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.417360 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.417362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.417430 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.417859 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.417864 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.419807 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 00:50:59.419993 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.414863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:59455 (local address 127.26.99.190:33159)
0811 00:50:59.414925 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.414927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.414936 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:59.414962 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.414963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.414973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.415039 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.415318 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.416020 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.417005 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.417283 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.417358 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.419931 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:59455: BlockingRecv error: recv got EOF from 127.26.99.130:59455 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.425577 11391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.420606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:47113)
0811 00:50:59.420648 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.420657 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.420691 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.420799 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.420799 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.420930 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.420962 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.420964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.421810 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.421811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.422582 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.422585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.423084 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.423086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.423146 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.423526 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.423530 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.425516 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 00:50:59.425727 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.420649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47113 (local address 127.26.99.190:33159)
0811 00:50:59.420695 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.420697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.420708 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:50:59.420731 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.420732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.420741 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.420795 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.421020 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.421736 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.422656 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.422958 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.423032 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.425637 (+ 2605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:47113: BlockingRecv error: recv got EOF from 127.26.99.130:47113 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 00:50:59.425820 11385 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:50:59.496914 11392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:50:59.497099 11392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:50:59.497121 11392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:50:59.498543 11392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:50:59.498584 11392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:50:59.498610 11392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:50:59.500054 11392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:46537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/krb5kdc/oryx_127.26.99.131.keytab
--principal=oryx/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:38379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=45343
--tserver_master_addrs=127.26.99.190:33159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:50:59.500264 11392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:50:59.500510 11392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:50:59.505220 11401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.505252 11400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:50:59.505224 11404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:50:59.505481 11392 server_base.cc:1034] running on GCE node
I20260811 00:50:59.505688 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:50:59.505921 11392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:50:59.507088 11392 hybrid_clock.cc:648] HybridClock initialized: now 1786409459507075 us; error 29 us; skew 500 ppm
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409459, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:50:59.509585 11392 init.cc:377] Logged in from keytab as oryx/127.26.99.131@KRBTEST.COM (short username oryx)
I20260811 00:50:59.510025 11392 webserver.cc:460] Webserver started at http://127.26.99.131:45343/ using document root <none> and password file <none>
I20260811 00:50:59.510260 11392 fs_manager.cc:359] Metadata directory not provided
I20260811 00:50:59.510319 11392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:50:59.511582 11392 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:50:59.512109 11416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.512256 11392 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.512360 11392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "9e887c91ccec4b35aa7266d4865cf924"
format_stamp: "Formatted at 2026-08-11 00:50:58 on dist-test-slave-xt4k"
server_key: "f57e95ac51472dc556ef306c8cf610d9"
server_key_iv: "47d9457b09ee72b5dbe1c94476c8f000"
server_key_version: "encryptionkey@0"
I20260811 00:50:59.512681 11392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:50:59.533598 11392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:50:59.535629 11392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:50:59.535739 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:50:59.535967 11392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:50:59.536274 11392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:50:59.536309 11392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.536368 11392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:50:59.536388 11392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:50:59.542058 11392 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38379
I20260811 00:50:59.542114 11637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38379 every 8 connection(s)
I20260811 00:50:59.542526 11392 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:50:59.544785 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 11392
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.549993 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.543224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:56725)
0811 00:50:59.543390 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.543426 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.543886 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.544105 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.544109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.544725 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.544940 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.544946 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.545850 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.545851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.546699 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.546702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.547043 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.547044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.547157 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.547628 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.547638 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.549852 (+ 2214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
W20260811 00:50:59.550002 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.543237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:56725 (local address 127.26.99.190:33159)
0811 00:50:59.543322 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.543324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.543505 (+ 181us) server_negotiation.cc:407] Connection header received
0811 00:50:59.543981 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.543982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.543992 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.544044 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.545018 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.545764 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.546782 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.546976 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.547030 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.549942 (+ 2912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:56725: BlockingRecv error: recv got EOF from 127.26.99.131:56725 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 00:50:59.550230 11638 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:33159 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.99.190:33159: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
I20260811 00:50:59.551816 11647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.545242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60840 (local address 127.26.99.190:33159)
0811 00:50:59.545353 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.545355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.545362 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:50:59.545424 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.545424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.545433 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.545482 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.546199 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.546664 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.547423 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.547686 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.547759 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.548945 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:50:59.548949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:50:59.548949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:50:59.548959 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:50:59.550567 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:59.550904 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:59.550907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:59.550908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:59.550996 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:50:59.551178 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:50:59.551178 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:50:59.551179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:50:59.551372 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:50:59.551475 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 00:50:59.551609 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 00:50:59.551719 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.554387 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.550471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:53745)
0811 00:50:59.550514 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.550522 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.550555 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.550688 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.550689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.550791 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.550831 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.550832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.551487 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.551488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.552191 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.552194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.552649 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.552650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.552702 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.552974 (+ 272us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.552978 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.554347 (+ 1369us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 00:50:59.554492 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.550514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:53745 (local address 127.26.99.190:33159)
0811 00:50:59.550548 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.550550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.550559 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:50:59.550611 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.550611 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.550619 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.550679 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.550892 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.551414 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.552275 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.552571 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.552632 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.554427 (+ 1795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:53745: BlockingRecv error: recv got EOF from 127.26.99.131:53745 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:50:59 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:50:59.557966 11641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:50:59.554672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:56045)
0811 00:50:59.554713 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 00:50:59.554724 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:50:59.554764 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:50:59.554873 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:50:59.554873 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:50:59.554967 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:50:59.554990 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.554991 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.555514 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.555514 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.555963 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:50:59.555964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.556277 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.556277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:50:59.556310 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.556621 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:50:59.556624 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:50:59.557926 (+ 1302us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 00:50:59.558041 11149 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:50:59.554741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:56045 (local address 127.26.99.190:33159)
0811 00:50:59.554786 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:50:59.554787 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:50:59.554805 (+ 18us) server_negotiation.cc:407] Connection header received
0811 00:50:59.554820 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:50:59.554821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:50:59.554827 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:50:59.554861 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:50:59.555037 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.555444 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.556039 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:50:59.556217 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:50:59.556274 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:50:59.557995 (+ 1721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:56045: BlockingRecv error: recv got EOF from 127.26.99.131:56045 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 00:50:59.558157 11638 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:00.282676 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:00.278133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:43089)
0811 00:51:00.278262 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:00.278273 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:00.278353 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:00.278484 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:00.278484 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:00.278646 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:00.278701 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.278703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.279372 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.279373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.279917 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.279919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.280248 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.280249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.280292 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.280749 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:00.280754 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:00.282604 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
W20260811 00:51:00.282748 11649 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:00.278213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:43089 (local address 127.26.99.190:33159)
0811 00:51:00.278318 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:00.278320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:00.278330 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:51:00.278415 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:00.278416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:00.278427 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:00.278474 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:00.278787 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.279304 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.279991 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.280196 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.280242 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.282687 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:43089: BlockingRecv error: recv got EOF from 127.26.99.129:43089 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":56,"threads_started":1}
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:00.430397 11650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:00.426164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:56295)
0811 00:51:00.426293 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:00.426303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:00.426360 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:00.426489 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:00.426489 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:00.426651 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:00.426703 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.426705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.427316 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.427317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.427870 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.427872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.428195 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.428195 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.428231 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.428630 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:00.428634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:00.430312 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
W20260811 00:51:00.430507 11649 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:00.426210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:56295 (local address 127.26.99.190:33159)
0811 00:51:00.426292 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:00.426293 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:00.426344 (+ 51us) server_negotiation.cc:407] Connection header received
0811 00:51:00.426401 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:00.426402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:00.426412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:00.426480 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:00.426751 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.427249 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.427943 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.428139 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.428193 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.430415 (+ 2222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:56295: BlockingRecv error: recv got EOF from 127.26.99.130:56295 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:00 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:00.563113 11651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:00.558608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:33103)
0811 00:51:00.558737 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:00.558749 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:00.558800 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:00.558915 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:00.558915 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:00.559080 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:00.559132 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.559134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.559778 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.559779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.560372 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:00.560375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.560718 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.560719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:00.560760 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.561190 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:00.561195 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:00.563036 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
W20260811 00:51:00.563185 11649 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:00.558711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:33103 (local address 127.26.99.190:33159)
0811 00:51:00.558799 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:00.558801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:00.558810 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:00.558835 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:00.558836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:00.558848 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:00.558902 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:00.559186 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.559676 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.560464 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:00.560660 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:00.560715 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:00.563130 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:33103: BlockingRecv error: recv got EOF from 127.26.99.131:33103 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:01.287619 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:01.283158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:54205)
0811 00:51:01.283291 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:01.283301 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:01.283357 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:01.283481 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:01.283482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:01.283644 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:01.283703 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.283704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.284489 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.284490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.285029 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.285030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.285379 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.285379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.285416 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.285892 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:01.285897 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:01.287555 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
W20260811 00:51:01.287773 11653 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:01.283240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:54205 (local address 127.26.99.190:33159)
0811 00:51:01.283353 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:01.283355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:01.283365 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:51:01.283404 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:01.283405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:01.283415 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:01.283471 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:01.283816 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.284366 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.285118 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.285321 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.285376 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.287689 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:54205: BlockingRecv error: recv got EOF from 127.26.99.129:54205 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:01.435441 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:01.430937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:59327)
0811 00:51:01.431184 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:01.431198 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:01.431274 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:01.431408 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:01.431409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:01.431589 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:01.431641 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.431642 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.432285 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.432286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.432858 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.432860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.433182 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.433183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.433233 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.433685 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:01.433691 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:01.435360 (+ 1669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":171,"threads_started":1}
W20260811 00:51:01.435527 11653 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:01.431137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:59327 (local address 127.26.99.190:33159)
0811 00:51:01.431202 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:01.431204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:01.431252 (+ 48us) server_negotiation.cc:407] Connection header received
0811 00:51:01.431334 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:01.431334 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:01.431347 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:01.431392 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:01.431708 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.432214 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.432931 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.433123 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.433178 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.435462 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:59327: BlockingRecv error: recv got EOF from 127.26.99.130:59327 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:01 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:01.567616 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:01.563572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:45491)
0811 00:51:01.563689 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:01.563699 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:01.563746 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:01.563857 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:01.563857 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:01.564013 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:01.564065 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.564067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.564702 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.564702 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.565222 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:01.565224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.565503 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.565504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:01.565538 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.565931 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:01.565936 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:01.567538 (+ 1602us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
W20260811 00:51:01.567674 11653 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:01.563708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:45491 (local address 127.26.99.190:33159)
0811 00:51:01.563758 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:01.563760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:01.563769 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:01.563789 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:01.563790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:01.563799 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:01.563847 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:01.564127 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.564648 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.565278 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:01.565455 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:01.565501 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:01.567623 (+ 2122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:45491: BlockingRecv error: recv got EOF from 127.26.99.131:45491 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:02.295900 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:02.288134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:33377)
0811 00:51:02.288282 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:02.288293 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:02.288367 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:02.288520 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:02.288521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:02.288689 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:02.288753 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.288754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.289420 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.289421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.289969 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.289970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.290328 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.290330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.290381 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.293972 (+ 3591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:02.293977 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:02.295820 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
W20260811 00:51:02.296000 11661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:02.288234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:33377 (local address 127.26.99.190:33159)
0811 00:51:02.288386 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:02.288388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:02.288414 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:51:02.288437 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:02.288438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:02.288447 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:02.288497 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:02.288827 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.289348 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.290050 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.290259 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.290313 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.295925 (+ 5612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:33377: BlockingRecv error: recv got EOF from 127.26.99.129:33377 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:02.440062 11668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:02.435967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:50353)
0811 00:51:02.436083 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:02.436094 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:02.436153 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:02.436281 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:02.436282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:02.436470 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:02.436521 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.436522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.437140 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.437141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.437662 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.437663 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.437934 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.437934 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.437969 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.438351 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:02.438356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:02.440002 (+ 1646us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":65,"threads_started":1}
W20260811 00:51:02.440158 11661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:02.436036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:50353 (local address 127.26.99.190:33159)
0811 00:51:02.436107 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:02.436108 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:02.436149 (+ 41us) server_negotiation.cc:407] Connection header received
0811 00:51:02.436202 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:02.436203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:02.436214 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:02.436268 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:02.436582 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.437085 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.437713 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.437890 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.437931 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.440096 (+ 2165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:50353: BlockingRecv error: recv got EOF from 127.26.99.130:50353 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:02 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:02.573257 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:02.568118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:59761)
0811 00:51:02.568283 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:02.568294 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:02.568376 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:02.568579 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:02.568580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:02.568854 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:02.568910 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.568912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.569689 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.569690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.570234 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:02.570235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.570694 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.570696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:02.570751 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.571185 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:02.571190 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:02.573175 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":73,"threads_started":1}
W20260811 00:51:02.573331 11661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:02.568233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:59761 (local address 127.26.99.190:33159)
0811 00:51:02.568293 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:02.568295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:02.568376 (+ 81us) server_negotiation.cc:407] Connection header received
0811 00:51:02.568461 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:02.568462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:02.568475 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:02.568524 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:02.569017 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.569616 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.570325 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:02.570605 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:02.570662 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:02.573275 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:59761: BlockingRecv error: recv got EOF from 127.26.99.131:59761 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:03.300642 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:03.296412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:51587)
0811 00:51:03.296546 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:03.296557 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:03.296605 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:03.296737 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:03.296738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:03.296900 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:03.296956 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.296957 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.297593 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.297593 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.298110 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.298111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.298427 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.298428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.298476 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.298914 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:03.298919 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:03.300582 (+ 1663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
W20260811 00:51:03.300743 11678 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:03.296488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:51587 (local address 127.26.99.190:33159)
0811 00:51:03.296607 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:03.296610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:03.296619 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:03.296646 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:03.296646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:03.296656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:03.296731 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:03.297010 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.297537 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.298168 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.298359 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.298405 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.300675 (+ 2270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:51587: BlockingRecv error: recv got EOF from 127.26.99.129:51587 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:03.445010 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:03.440567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:57775)
0811 00:51:03.440716 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:03.440726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:03.440791 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:03.440919 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:03.440920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:03.441092 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:03.441145 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.441147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.441762 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.441763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.442296 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.442298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.442588 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.442589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.442641 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.443087 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:03.443092 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:03.444939 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
W20260811 00:51:03.445104 11678 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:03.440651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:57775 (local address 127.26.99.190:33159)
0811 00:51:03.440725 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:03.440727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:03.440789 (+ 62us) server_negotiation.cc:407] Connection header received
0811 00:51:03.440838 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:03.440839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:03.440849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:03.440898 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:03.441200 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.441705 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.442352 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.442541 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.442585 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.445042 (+ 2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:57775: BlockingRecv error: recv got EOF from 127.26.99.130:57775 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:03 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:03.577975 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:03.573733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:35915)
0811 00:51:03.573877 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:03.573887 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:03.573943 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:03.574063 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:03.574064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:03.574227 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:03.574280 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.574282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.574895 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.574896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.575422 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:03.575423 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.575775 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.575776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:03.575831 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.576251 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:03.576256 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:03.577910 (+ 1654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
W20260811 00:51:03.578061 11678 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:03.573810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:35915 (local address 127.26.99.190:33159)
0811 00:51:03.573858 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:03.573860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:03.573939 (+ 79us) server_negotiation.cc:407] Connection header received
0811 00:51:03.573996 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:03.573997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:03.574009 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:03.574049 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:03.574330 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.574837 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.575491 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:03.575685 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:03.575740 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:03.577997 (+ 2257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:35915: BlockingRecv error: recv got EOF from 127.26.99.131:35915 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:04.305624 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:04.301138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:45443)
0811 00:51:04.301291 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:04.301303 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:04.301360 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:04.301482 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:04.301482 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:04.301650 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:04.301704 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.301706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.302432 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.302434 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.303012 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.303015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.303372 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.303373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.303426 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.303873 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:04.303877 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:04.305563 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
W20260811 00:51:04.305755 11684 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:04.301222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:45443 (local address 127.26.99.190:33159)
0811 00:51:04.301349 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:04.301352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:04.301360 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:04.301405 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:04.301406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:04.301416 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:04.301469 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:04.301796 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.302336 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.303100 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.303300 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.303354 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.305667 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:45443: BlockingRecv error: recv got EOF from 127.26.99.129:45443 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":53,"threads_started":1}
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:04.449991 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:04.445480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:45381)
0811 00:51:04.445629 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:04.445641 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:04.445716 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:04.445846 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:04.445847 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:04.446007 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:04.446064 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.446066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.446714 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.446715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.447246 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.447247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.447582 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.447583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.447618 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.448064 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:04.448071 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:04.449931 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
W20260811 00:51:04.450086 11684 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:04.445631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:45381 (local address 127.26.99.190:33159)
0811 00:51:04.445690 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:04.445698 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:04.445706 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:04.445775 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:04.445776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:04.445787 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:04.445834 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:04.446135 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.446653 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.447320 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.447525 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.447581 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.450024 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:45381: BlockingRecv error: recv got EOF from 127.26.99.130:45381 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:04 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:04.583067 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:04.578401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:40573)
0811 00:51:04.578541 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:04.578551 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:04.578610 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:04.578730 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:04.578731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:04.578921 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:04.578995 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.578997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.579706 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.579707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.580282 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:04.580285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.580657 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.580657 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:04.580715 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.581237 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:04.581241 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:04.583006 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
W20260811 00:51:04.583153 11684 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:04.578489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:40573 (local address 127.26.99.190:33159)
0811 00:51:04.578558 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:04.578560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:04.578594 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:51:04.578657 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:04.578658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:04.578671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:04.578716 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:04.579079 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.579625 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.580381 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:04.580593 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:04.580655 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:04.583089 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:40573: BlockingRecv error: recv got EOF from 127.26.99.131:40573 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:05.310730 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:05.306131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:33469)
0811 00:51:05.306273 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:05.306283 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:05.306333 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:05.306480 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:05.306481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:05.306647 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:05.306699 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.306700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.307364 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.307365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.307932 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.307934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.308243 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.308243 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.308280 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.308859 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:05.308865 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:05.310665 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
W20260811 00:51:05.310822 11689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:05.306209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:33469 (local address 127.26.99.190:33159)
0811 00:51:05.306348 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:05.306350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:05.306359 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:05.306383 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:05.306384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:05.306400 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:05.306463 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:05.306790 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.307304 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.307990 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.308189 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.308239 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.310753 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:33469: BlockingRecv error: recv got EOF from 127.26.99.129:33469 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:05.455225 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:05.450488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:49235)
0811 00:51:05.450651 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:05.450667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:05.450743 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:05.450890 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:05.450892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:05.451126 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:05.451180 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.451182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.451859 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.451859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.452424 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.452425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.452808 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.452809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.452845 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.453288 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:05.453293 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:05.455147 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
W20260811 00:51:05.455313 11689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:05.450595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:49235 (local address 127.26.99.190:33159)
0811 00:51:05.450655 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:05.450658 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:05.450739 (+ 81us) server_negotiation.cc:407] Connection header received
0811 00:51:05.450811 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:05.450812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:05.450823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:05.450867 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:05.451260 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.451796 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.452531 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.452742 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.452801 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.455259 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:49235: BlockingRecv error: recv got EOF from 127.26.99.130:49235 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:05 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:05.587891 11695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:05.583536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:42687)
0811 00:51:05.583706 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:05.583718 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:05.583776 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:05.583902 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:05.583902 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:05.584076 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:05.584126 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.584128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.584794 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.584795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.585336 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:05.585338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.585628 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.585628 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:05.585664 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.586126 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:05.586131 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:05.587831 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
W20260811 00:51:05.587970 11689 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:05.583611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:42687 (local address 127.26.99.190:33159)
0811 00:51:05.583669 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:05.583671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:05.583767 (+ 96us) server_negotiation.cc:407] Connection header received
0811 00:51:05.583827 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:05.583827 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:05.583840 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:05.583889 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:05.584174 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.584722 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.585405 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:05.585584 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:05.585624 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:05.587905 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:42687: BlockingRecv error: recv got EOF from 127.26.99.131:42687 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:06.315883 11697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:06.311210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:57925)
0811 00:51:06.311345 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:06.311355 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:06.311403 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:06.311561 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:06.311562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:06.311729 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:06.311780 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.311781 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.312492 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.312494 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.313054 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.313055 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.313469 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.313471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.313534 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.314053 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:06.314059 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:06.315823 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
W20260811 00:51:06.316012 11698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:06.311320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:57925 (local address 127.26.99.190:33159)
0811 00:51:06.311440 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:06.311442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:06.311450 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:06.311474 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:06.311475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:06.311485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:06.311543 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:06.311853 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.312398 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.313141 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.313379 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.313439 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.315930 (+ 2491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:57925: BlockingRecv error: recv got EOF from 127.26.99.129:57925 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":53,"threads_started":1}
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:06.460090 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:06.455799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:50927)
0811 00:51:06.455956 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:06.455967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:06.456028 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:06.456142 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:06.456142 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:06.456308 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:06.456386 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.456387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.456998 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.456999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.457536 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.457537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.457831 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.457832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.457877 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.458280 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:06.458284 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:06.460015 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
W20260811 00:51:06.460191 11698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:06.455874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:50927 (local address 127.26.99.190:33159)
0811 00:51:06.455938 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:06.455941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:06.456022 (+ 81us) server_negotiation.cc:407] Connection header received
0811 00:51:06.456072 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:06.456073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:06.456084 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:06.456131 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:06.456436 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.456935 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.457592 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.457770 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.457813 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.460123 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:50927: BlockingRecv error: recv got EOF from 127.26.99.130:50927 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:06 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:06.592940 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:06.588443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:39131)
0811 00:51:06.588575 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:06.588586 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:06.588646 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:06.588776 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:06.588777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:06.588942 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:06.588997 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.588999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.589630 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.589631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.590159 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:06.590160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.590507 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.590508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:06.590552 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.590995 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:06.591000 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:06.592852 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260811 00:51:06.593000 11698 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:06.588513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:39131 (local address 127.26.99.190:33159)
0811 00:51:06.588598 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:06.588599 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:06.588631 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:51:06.588700 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:06.588701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:06.588713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:06.588759 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:06.589053 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.589573 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.590234 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:06.590447 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:06.590501 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:06.592946 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:39131: BlockingRecv error: recv got EOF from 127.26.99.131:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:07.326009 11701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:07.316374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:32791)
0811 00:51:07.316517 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:07.316527 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:07.316580 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:07.316765 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:07.316766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:07.316929 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:07.316984 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.316986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.317658 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.317658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.318195 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.318196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.318608 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.318610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.318668 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.323978 (+ 5310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:07.323983 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:07.325921 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
W20260811 00:51:07.326097 11703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:07.316514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:32791 (local address 127.26.99.190:33159)
0811 00:51:07.316616 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:07.316617 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:07.316625 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:07.316648 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:07.316649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:07.316658 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:07.316718 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:07.317073 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.317595 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.318277 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.318510 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.318584 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.326033 (+ 7449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:32791: BlockingRecv error: recv got EOF from 127.26.99.129:32791 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":47,"threads_started":1}
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:07.465260 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:07.460620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:34135)
0811 00:51:07.460784 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:07.460795 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:07.460853 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:07.460977 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:07.460977 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:07.461144 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:07.461197 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.461198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.461993 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.461994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.462545 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.462547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.462930 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.462931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.462981 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.463394 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:07.463398 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:07.465197 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
W20260811 00:51:07.465348 11703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:07.460700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:34135 (local address 127.26.99.190:33159)
0811 00:51:07.460759 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:07.460761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:07.460855 (+ 94us) server_negotiation.cc:407] Connection header received
0811 00:51:07.460896 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:07.460897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:07.460908 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:07.460964 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:07.461247 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.461917 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.462637 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.462852 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.462927 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.465287 (+ 2360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:34135: BlockingRecv error: recv got EOF from 127.26.99.130:34135 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:07 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:07.599025 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:07.593402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:32953)
0811 00:51:07.593523 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:07.593534 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:07.593596 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:07.593747 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:07.593748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:07.593959 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:07.594022 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.594024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.594972 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.594972 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.595821 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:07.595823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.596271 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.596272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:07.596326 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.596844 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:07.596849 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:07.598963 (+ 2114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
W20260811 00:51:07.599143 11703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:07.593443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:32953 (local address 127.26.99.190:33159)
0811 00:51:07.593501 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:07.593503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:07.593593 (+ 90us) server_negotiation.cc:407] Connection header received
0811 00:51:07.593644 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:07.593645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:07.593661 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:07.593732 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:07.594097 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.594900 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.595903 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:07.596201 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:07.596262 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:07.599075 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:32953: BlockingRecv error: recv got EOF from 127.26.99.131:32953 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:08.331131 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:08.326527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:42977)
0811 00:51:08.326658 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:08.326668 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:08.326729 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:08.326870 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:08.326870 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:08.327039 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:08.327090 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.327092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.327746 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.327746 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.328262 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.328263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.328669 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.328671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.328737 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.329169 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:08.329173 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:08.331039 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
W20260811 00:51:08.331204 11708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:08.326587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:42977 (local address 127.26.99.190:33159)
0811 00:51:08.326752 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:08.326754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:08.326762 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:08.326785 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:08.326785 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:08.326796 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:08.326860 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:08.327156 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.327685 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.328363 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.328578 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.328645 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.331140 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:42977: BlockingRecv error: recv got EOF from 127.26.99.129:42977 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:08.470584 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:08.465837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:52913)
0811 00:51:08.465977 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:08.465988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:08.466038 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:08.466162 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:08.466163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:08.466333 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:08.466387 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.466389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.467079 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.467081 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.467647 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.467649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.468017 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.468019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.468080 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.468548 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:08.468553 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:08.470507 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
W20260811 00:51:08.470739 11708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:08.465946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:52913 (local address 127.26.99.190:33159)
0811 00:51:08.466016 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:08.466018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:08.466029 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:51:08.466086 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:08.466087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:08.466098 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:08.466150 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:08.466471 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.466996 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.467727 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.467929 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.467983 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.470621 (+ 2638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:52913: BlockingRecv error: recv got EOF from 127.26.99.130:52913 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:08 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:08.604010 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:08.599489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:52963)
0811 00:51:08.599642 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:08.599653 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:08.599706 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:08.599837 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:08.599838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:08.600010 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:08.600059 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.600060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.600788 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.600790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.601327 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:08.601328 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.601665 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.601665 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:08.601705 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.602116 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:08.602120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:08.603937 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
W20260811 00:51:08.604085 11708 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:08.599586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:52963 (local address 127.26.99.190:33159)
0811 00:51:08.599665 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:08.599667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:08.599700 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:51:08.599766 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:08.599767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:08.599780 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:08.599830 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:08.600136 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.600676 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.601417 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:08.601609 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:08.601660 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:08.604028 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:52963: BlockingRecv error: recv got EOF from 127.26.99.131:52963 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:09.336264 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:09.331640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:50657)
0811 00:51:09.331785 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:09.331799 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:09.331861 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:09.331986 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:09.331987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:09.332164 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:09.332218 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.332219 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.332902 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.332910 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.333544 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.333547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.333943 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.333945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.334011 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.334471 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:09.334476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:09.336186 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
W20260811 00:51:09.336385 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:09.331713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:50657 (local address 127.26.99.190:33159)
0811 00:51:09.331847 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:09.331849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:09.331857 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:09.331909 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:09.331910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:09.331920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:09.331976 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:09.332270 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.332806 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.333635 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.333872 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.333932 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.336294 (+ 2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:50657: BlockingRecv error: recv got EOF from 127.26.99.129:50657 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:09.475756 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:09.471044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:55453)
0811 00:51:09.471187 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:09.471197 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:09.471255 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:09.471385 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:09.471386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:09.471567 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:09.471620 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.471622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.472352 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.472353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.473022 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.473025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.473399 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.473400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.473454 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.473918 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:09.473924 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:09.475676 (+ 1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
W20260811 00:51:09.475843 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:09.471120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:55453 (local address 127.26.99.190:33159)
0811 00:51:09.471178 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:09.471179 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:09.471250 (+ 71us) server_negotiation.cc:407] Connection header received
0811 00:51:09.471304 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:09.471304 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:09.471315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:09.471374 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:09.471706 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.472237 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.473124 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.473327 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.473391 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.475787 (+ 2396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:55453: BlockingRecv error: recv got EOF from 127.26.99.130:55453 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:09 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:09.608960 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:09.604498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:51985)
0811 00:51:09.604654 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:09.604668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:09.604742 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:09.604873 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:09.604874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:09.605046 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:09.605105 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.605106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.605755 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.605756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.606275 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:09.606277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.606595 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.606596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:09.606651 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.607070 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:09.607076 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:09.608892 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":60,"threads_started":1}
W20260811 00:51:09.609062 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:09.604623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:51985 (local address 127.26.99.190:33159)
0811 00:51:09.604679 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:09.604681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:09.604721 (+ 40us) server_negotiation.cc:407] Connection header received
0811 00:51:09.604798 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:09.604799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:09.604814 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:09.604860 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:09.605179 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.605685 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.606349 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:09.606534 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:09.606595 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:09.608982 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:51985: BlockingRecv error: recv got EOF from 127.26.99.131:51985 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:10.341616 11731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:10.336770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:34245)
0811 00:51:10.336897 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:10.336908 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:10.336959 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:10.337208 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:10.337209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:10.337387 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:10.337439 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.337441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.338304 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.338305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.338866 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.338869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.339250 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.339251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.339310 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.339776 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:10.339781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:10.341545 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":60,"threads_started":1}
W20260811 00:51:10.341759 11732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:10.336871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:34245 (local address 127.26.99.190:33159)
0811 00:51:10.336989 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:10.336991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:10.337002 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:51:10.337023 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:10.337024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:10.337034 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:10.337101 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:10.337518 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.338218 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.338954 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.339159 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.339224 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.341677 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:34245: BlockingRecv error: recv got EOF from 127.26.99.129:34245 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:10.480607 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:10.476204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:37309)
0811 00:51:10.476360 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:10.476370 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:10.476427 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:10.476553 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:10.476554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:10.476722 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:10.476773 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.476775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.477400 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.477402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.477995 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.477997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.478285 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.478286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.478323 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.478729 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:10.478733 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:10.480514 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
W20260811 00:51:10.480674 11732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:10.476251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37309 (local address 127.26.99.190:33159)
0811 00:51:10.476298 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:10.476300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:10.476419 (+ 119us) server_negotiation.cc:407] Connection header received
0811 00:51:10.476485 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:10.476486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:10.476499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:10.476548 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:10.476824 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.477326 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.478052 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.478239 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.478282 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.480616 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:37309: BlockingRecv error: recv got EOF from 127.26.99.130:37309 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:10 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:10.614212 11734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:10.609410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:33681)
0811 00:51:10.609530 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:10.609543 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:10.609604 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:10.609799 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:10.609801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:10.610001 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:10.610055 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.610057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.610668 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.610669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.611215 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:10.611217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.611623 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.611624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:10.611681 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.612279 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:10.612285 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:10.614120 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":59,"threads_started":1}
W20260811 00:51:10.614279 11732 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:10.609507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:33681 (local address 127.26.99.190:33159)
0811 00:51:10.609596 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:10.609598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:10.609607 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:10.609661 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:10.609661 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:10.609674 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:10.609740 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:10.610116 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.610614 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.611294 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:10.611491 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:10.611550 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:10.614225 (+ 2675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:33681: BlockingRecv error: recv got EOF from 127.26.99.131:33681 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:11.346447 11737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:11.342063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:45829)
0811 00:51:11.342195 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:11.342205 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:11.342254 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:11.342386 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:11.342387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:11.342572 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:11.342625 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.342627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.343252 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.343253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.343802 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.343804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.344096 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.344097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.344134 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.344592 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:11.344597 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:11.346377 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
W20260811 00:51:11.346566 11738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:11.342131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:45829 (local address 127.26.99.190:33159)
0811 00:51:11.342253 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:11.342255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:11.342263 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:11.342298 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:11.342298 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:11.342309 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:11.342367 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:11.342689 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.343197 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.343858 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.344047 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.344091 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.346486 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:45829: BlockingRecv error: recv got EOF from 127.26.99.129:45829 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:11.485680 11740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:11.481064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:39929)
0811 00:51:11.481223 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:11.481235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:11.481308 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:11.481449 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:11.481450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:11.481672 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:11.481734 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.481736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.482516 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.482517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.483073 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.483075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.483427 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.483428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.483469 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.483882 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:11.483887 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:11.485609 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":73,"threads_started":1}
W20260811 00:51:11.485759 11738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:11.481145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:39929 (local address 127.26.99.190:33159)
0811 00:51:11.481216 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:11.481219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:11.481286 (+ 67us) server_negotiation.cc:407] Connection header received
0811 00:51:11.481363 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:11.481364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:11.481376 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:11.481426 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:11.481811 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.482444 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.483165 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.483364 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.483422 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.485698 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:39929: BlockingRecv error: recv got EOF from 127.26.99.130:39929 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:11 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:11.619151 11742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:11.614694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:46765)
0811 00:51:11.614865 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:11.614876 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:11.614938 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:11.615058 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:11.615058 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:11.615230 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:11.615282 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.615283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.615977 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.615978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.616528 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:11.616529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.616855 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.616856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:11.616898 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.617339 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:11.617343 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:11.619080 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":86,"threads_started":1}
W20260811 00:51:11.619230 11738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:11.614808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:46765 (local address 127.26.99.190:33159)
0811 00:51:11.614859 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:11.614861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:11.614921 (+ 60us) server_negotiation.cc:407] Connection header received
0811 00:51:11.614980 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:11.614980 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:11.614994 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:11.615040 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:11.615364 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.615921 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.616616 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:11.616800 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:11.616849 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:11.619165 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:46765: BlockingRecv error: recv got EOF from 127.26.99.131:46765 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:12.355232 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:12.346897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:46995)
0811 00:51:12.347026 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:12.347042 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:12.347102 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:12.347216 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:12.347217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:12.347395 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:12.347445 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.347446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.348108 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.348109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.348682 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.348684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.349024 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.349025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.349085 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.353204 (+ 4119us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:12.353209 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:12.355070 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
W20260811 00:51:12.355260 11744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:12.346973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:46995 (local address 127.26.99.190:33159)
0811 00:51:12.347109 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:12.347111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:12.347120 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:12.347145 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:12.347146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:12.347158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:12.347214 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:12.347520 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.348034 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.348757 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.348964 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.349017 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.355203 (+ 6186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:46995: BlockingRecv error: recv got EOF from 127.26.99.129:46995 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:12.490495 11748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:12.486142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:33675)
0811 00:51:12.486306 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:12.486321 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:12.486391 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:12.486538 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:12.486539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:12.486717 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:12.486772 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.486774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.487422 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.487423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.487947 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.487949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.488266 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.488267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.488324 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.488760 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:12.488764 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:12.490436 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
W20260811 00:51:12.490607 11744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:12.486272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:33675 (local address 127.26.99.190:33159)
0811 00:51:12.486331 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:12.486333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:12.486371 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:51:12.486453 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:12.486454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:12.486465 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:12.486526 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:12.486844 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.487350 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.488015 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.488207 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.488262 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.490546 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:33675: BlockingRecv error: recv got EOF from 127.26.99.130:33675 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:12 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:12.624025 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:12.619597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:46541)
0811 00:51:12.619718 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:12.619728 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:12.619790 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:12.619897 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:12.619898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:12.620082 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:12.620134 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.620135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.620772 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.620772 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.621312 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:12.621314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.621592 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.621592 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:12.621635 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.622046 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:12.622050 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:12.623927 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
W20260811 00:51:12.624090 11744 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:12.619672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:46541 (local address 127.26.99.190:33159)
0811 00:51:12.619730 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:12.619732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:12.619784 (+ 52us) server_negotiation.cc:407] Connection header received
0811 00:51:12.619841 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:12.619841 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:12.619854 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:12.619892 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:12.620184 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.620719 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.621370 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:12.621547 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:12.621588 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:12.624037 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:46541: BlockingRecv error: recv got EOF from 127.26.99.131:46541 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:13.360459 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:13.355803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:36201)
0811 00:51:13.355952 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:13.355963 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:13.356026 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:13.356141 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:13.356142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:13.356310 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:13.356385 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.356386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.357044 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.357045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.357591 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.357593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.357969 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.357970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.358027 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.358479 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:13.358484 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:13.360383 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
W20260811 00:51:13.360507 11751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:13.355904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:36201 (local address 127.26.99.190:33159)
0811 00:51:13.356018 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:13.356020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:13.356029 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:51:13.356071 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:13.356071 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:13.356082 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:13.356137 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:13.356449 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.356968 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.357667 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.357867 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.357930 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.360448 (+ 2518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:36201: BlockingRecv error: recv got EOF from 127.26.99.129:36201 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:13.495510 11752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:13.490999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:56769)
0811 00:51:13.491129 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:13.491140 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:13.491208 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:13.491347 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:13.491348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:13.491521 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:13.491573 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.491575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.492260 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.492260 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.492848 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.492851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.493233 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.493234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.493296 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.493728 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:13.493732 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:13.495430 (+ 1698us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
W20260811 00:51:13.495586 11751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:13.491094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:56769 (local address 127.26.99.190:33159)
0811 00:51:13.491155 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:13.491157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:13.491205 (+ 48us) server_negotiation.cc:407] Connection header received
0811 00:51:13.491278 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:13.491279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:13.491290 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:13.491334 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:13.491663 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.492196 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.492919 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.493158 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.493222 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.495532 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:56769: BlockingRecv error: recv got EOF from 127.26.99.130:56769 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:13 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.131@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:13.628819 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:13.624462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.131:57059)
0811 00:51:13.624604 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:13.624616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:13.624683 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:13.624808 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:13.624809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:13.625035 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:13.625104 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.625107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.625744 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.625745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.626270 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:13.626272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.626590 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.626591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:13.626644 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.627046 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:13.627051 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:13.628759 (+ 1708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
W20260811 00:51:13.628909 11751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:13.624530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:57059 (local address 127.26.99.190:33159)
0811 00:51:13.624582 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:13.624584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:13.624672 (+ 88us) server_negotiation.cc:407] Connection header received
0811 00:51:13.624733 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:13.624734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:13.624748 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:13.624798 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:13.625169 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.625673 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.626344 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:13.626530 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:13.626586 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:13.628842 (+ 2256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.131:57059: BlockingRecv error: recv got EOF from 127.26.99.131:57059 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 11 00:51:14 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:14 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.129@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:14.365478 11754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:14.360996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.129:60065)
0811 00:51:14.361149 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:14.361159 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:14.361208 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:14.361338 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:14.361339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:14.361497 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:14.361573 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.361576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.362336 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.362337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.362887 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.362889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.363259 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.363259 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.363298 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.363719 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:14.363724 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:14.365419 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
W20260811 00:51:14.365615 11756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:14.361089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:60065 (local address 127.26.99.190:33159)
0811 00:51:14.361221 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:14.361223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:14.361231 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:14.361254 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:14.361255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:14.361265 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:14.361328 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:14.361648 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.362267 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.362986 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.363191 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.363249 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.365536 (+ 2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.129:60065: BlockingRecv error: recv got EOF from 127.26.99.129:60065 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
Aug 11 00:51:14 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 00:51:14 dist-test-slave-xt4k krb5kdc[9822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.99.130@KRBTEST.COM for oryx/127.26.99.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 00:51:14.500315 11757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:14.496068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33159 (local address 127.26.99.130:47637)
0811 00:51:14.496193 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:14.496202 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:14.496261 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:14.496419 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:14.496420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:14.496583 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:14.496636 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.496638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.497240 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.497241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.497792 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.497793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.498102 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.498103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.498141 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.498539 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:14.498544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:14.500229 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.99.190:33159: Server oryx/127.26.99.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
W20260811 00:51:14.500488 11756 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:14.496133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47637 (local address 127.26.99.190:33159)
0811 00:51:14.496217 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:14.496219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:14.496249 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:51:14.496318 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:14.496319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:14.496329 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:14.496400 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:14.496689 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.497184 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.497851 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.498046 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.498098 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.500426 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.99.130:47637: BlockingRecv error: recv got EOF from 127.26.99.130:47637 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 00:51:14.554107 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 10866
I20260811 00:51:14.571120 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 11153
I20260811 00:51:14.583966 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 11392
I20260811 00:51:14.588675 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 10749
2026-08-11T00:51:14Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17699 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T00:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:51:14Z Disabled control of system clock
I20260811 00:51:14.621292 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39389
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:39389
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 00:51:14.700704 11770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:14.700898 11770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:14.700917 11770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:14.702106 11770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:51:14.702147 11770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:14.702157 11770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:14.702170 11770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:51:14.702193 11770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:51:14.703601 11770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:39389
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:14.703837 11770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:14.704130 11770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:14.710716 11778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:14.710794 11784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:14.710760 11780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:14.710868 11770 server_base.cc:1034] running on GCE node
I20260811 00:51:14.711154 11770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:14.711444 11770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:14.712581 11770 hybrid_clock.cc:648] HybridClock initialized: now 1786409474712570 us; error 40 us; skew 500 ppm
I20260811 00:51:14.713845 11770 webserver.cc:460] Webserver started at http://127.26.99.190:39051/ using document root <none> and password file <none>
I20260811 00:51:14.714097 11770 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:14.714160 11770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:14.714298 11770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:14.715351 11770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "6d0ff0a3175540969c289527bc8e5796"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e053993255d8615784c88ae7c85dadf9"
server_key_iv: "6b97d18868a2ee6294f7f498987574fc"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.715680 11770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "6d0ff0a3175540969c289527bc8e5796"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e053993255d8615784c88ae7c85dadf9"
server_key_iv: "6b97d18868a2ee6294f7f498987574fc"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.716925 11770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:51:14.717576 11796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:14.717718 11770 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:14.717800 11770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "6d0ff0a3175540969c289527bc8e5796"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e053993255d8615784c88ae7c85dadf9"
server_key_iv: "6b97d18868a2ee6294f7f498987574fc"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.717861 11770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:14.739182 11770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:14.739500 11770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:14.739630 11770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:14.743455 11770 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:39389
I20260811 00:51:14.743490 11878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:39389 every 8 connection(s)
I20260811 00:51:14.743822 11770 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:51:14.744591 11881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:14.745373 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 11770
I20260811 00:51:14.745461 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:51:14.745620 27022 external_mini_cluster.cc:1428] Setting key ca79b3187ff24b7daee2a0cde27787d3
I20260811 00:51:14.747786 11881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796: Bootstrap starting.
I20260811 00:51:14.748564 11881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:14.748881 11881 log.cc:824] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:14.749791 11881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796: No bootstrap required, opened a new log
I20260811 00:51:14.751708 11881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } }
I20260811 00:51:14.751986 11881 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:14.752069 11881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0ff0a3175540969c289527bc8e5796, State: Initialized, Role: FOLLOWER
I20260811 00:51:14.752238 11881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } }
I20260811 00:51:14.752364 11881 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:51:14.752399 11885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:14.746128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40640 (local address 127.26.99.190:39389)
0811 00:51:14.746348 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:14.746358 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:14.746393 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:51:14.746913 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:14.746923 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:14.747004 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:14.747158 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:14.747308 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.748627 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.749705 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.750342 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.750485 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.751391 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:14.751396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:14.751397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:14.751614 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:14.751659 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:14.751675 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:14.751737 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:14.751830 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 00:51:14.751918 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260811 00:51:14.752403 11881 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:51:14.752622 11881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:14.753300 11881 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } }
I20260811 00:51:14.753412 11881 leader_election.cc:302] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d0ff0a3175540969c289527bc8e5796; no voters:
I20260811 00:51:14.753575 11881 leader_election.cc:288] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:51:14.753615 11892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:51:14.753782 11892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0ff0a3175540969c289527bc8e5796, State: Running, Role: LEADER
I20260811 00:51:14.753856 11881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:51:14.753873 11892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } }
I20260811 00:51:14.756563 11893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d0ff0a3175540969c289527bc8e5796. Latest consensus state: current_term: 1 leader_uuid: "6d0ff0a3175540969c289527bc8e5796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } } }
I20260811 00:51:14.756647 11893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:14.756875 11906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:51:14.757165 11894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d0ff0a3175540969c289527bc8e5796" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d0ff0a3175540969c289527bc8e5796" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39389 } } }
I20260811 00:51:14.757241 11894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796 [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:14.757494 11906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:51:14.759199 11906 catalog_manager.cc:1347] Generated new cluster ID: 11807aed57d9492fb6f631d833cba666
I20260811 00:51:14.759255 11906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:51:14.770176 11906 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:51:14.770861 11906 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:51:14.776707 11906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d0ff0a3175540969c289527bc8e5796: Generated new TSK 0
I20260811 00:51:14.776885 11906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:51:14.782646 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--builtin_ntp_servers=127.26.99.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 00:51:14.866676 11920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:14.866890 11920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:14.866920 11920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:14.868093 11920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:14.868134 11920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:14.868165 11920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:51:14.869511 11920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:14.869755 11920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:14.870040 11920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:14.874939 11934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:14.874984 11920 server_base.cc:1034] running on GCE node
W20260811 00:51:14.874948 11931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:14.875102 11936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:14.875451 11920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:14.875690 11920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:14.876852 11920 hybrid_clock.cc:648] HybridClock initialized: now 1786409474876834 us; error 33 us; skew 500 ppm
I20260811 00:51:14.878103 11920 webserver.cc:460] Webserver started at http://127.26.99.129:39873/ using document root <none> and password file <none>
I20260811 00:51:14.878334 11920 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:14.878378 11920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:14.878499 11920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:14.879516 11920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "c8731670f0e946478cbce42f64259169"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "aa0544bb64e32acbe0a0725b0c1f1b25"
server_key_iv: "7108d4da8de5dff37eb3645bb04b29f8"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.879830 11920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "c8731670f0e946478cbce42f64259169"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "aa0544bb64e32acbe0a0725b0c1f1b25"
server_key_iv: "7108d4da8de5dff37eb3645bb04b29f8"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.881093 11920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:51:14.881778 11948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:14.881908 11920 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:51:14.882000 11920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "c8731670f0e946478cbce42f64259169"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "aa0544bb64e32acbe0a0725b0c1f1b25"
server_key_iv: "7108d4da8de5dff37eb3645bb04b29f8"
server_key_version: "encryptionkey@0"
I20260811 00:51:14.882066 11920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:14.891551 11920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:14.891781 11920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:14.891894 11920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:14.892081 11920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:14.892385 11920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:14.892427 11920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:14.892447 11920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:14.892462 11920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:14.898156 11920 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:34487
I20260811 00:51:14.898214 12158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:34487 every 8 connection(s)
I20260811 00:51:14.898494 11920 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:51:14.903152 11885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:14.899145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:51821 (local address 127.26.99.190:39389)
0811 00:51:14.899192 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:14.899195 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:14.899510 (+ 315us) server_negotiation.cc:407] Connection header received
0811 00:51:14.899993 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:14.899994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:14.900005 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:14.900061 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:14.900677 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.901172 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.902057 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.902231 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.902273 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.902947 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:14.902947 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:14.902948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:14.902958 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:14.902969 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:14.902972 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:14.903016 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:14.903070 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 00:51:14.903093 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:51:14.903357 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:14.899135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39389 (local address 127.26.99.129:51821)
0811 00:51:14.899374 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:14.899408 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:14.899879 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:14.900120 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:14.900123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:14.900132 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:14.900611 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.900615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.901235 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.901236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.901999 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:14.902001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:14.902282 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:14.902283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:14.902395 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:14.902839 (+ 444us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:14.902840 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:14.902865 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:14.902887 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:14.903020 (+ 133us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:14.903022 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:14.903024 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:51:14.903073 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:51:14.903148 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
I20260811 00:51:14.903842 12159 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39389
I20260811 00:51:14.903923 12159 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:14.904068 12159 heartbeater.cc:511] Master 127.26.99.190:39389 requested a full tablet report, sending...
I20260811 00:51:14.904525 11824 ts_manager.cc:194] Registered new tserver with Master: c8731670f0e946478cbce42f64259169 (127.26.99.129:34487)
I20260811 00:51:14.905153 11824 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.129:51821
I20260811 00:51:14.907948 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 11920
I20260811 00:51:14.908017 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:51:14.908180 27022 external_mini_cluster.cc:1428] Setting key 802f6e914ec900e1ca8a58712635310f
I20260811 00:51:14.908973 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--builtin_ntp_servers=127.26.99.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 00:51:14.989017 12162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:14.989208 12162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:14.989234 12162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:14.990411 12162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:14.990451 12162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:14.990484 12162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:51:14.991796 12162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:14.992012 12162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:14.992267 12162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:14.996949 12172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:14.997077 12162 server_base.cc:1034] running on GCE node
W20260811 00:51:14.996954 12177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:14.996958 12170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:14.997370 12162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:14.997601 12162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:14.998749 12162 hybrid_clock.cc:648] HybridClock initialized: now 1786409474998735 us; error 29 us; skew 500 ppm
I20260811 00:51:14.999939 12162 webserver.cc:460] Webserver started at http://127.26.99.130:45635/ using document root <none> and password file <none>
I20260811 00:51:15.000159 12162 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.000206 12162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.000357 12162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.001365 12162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "bbd4005acda94611acb4849e32fa959b"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e311e771ffa28c1bcc20faee385fc0d7"
server_key_iv: "0c5ee56602c9fc21425098ff7a99c6bb"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.001664 12162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "bbd4005acda94611acb4849e32fa959b"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e311e771ffa28c1bcc20faee385fc0d7"
server_key_iv: "0c5ee56602c9fc21425098ff7a99c6bb"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.002851 12162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:51:15.003453 12189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.003618 12162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:15.003721 12162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "bbd4005acda94611acb4849e32fa959b"
format_stamp: "Formatted at 2026-08-11 00:51:14 on dist-test-slave-xt4k"
server_key: "e311e771ffa28c1bcc20faee385fc0d7"
server_key_iv: "0c5ee56602c9fc21425098ff7a99c6bb"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.003789 12162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.027853 12162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.028177 12162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.028302 12162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.028586 12162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:15.028947 12162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:15.028990 12162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.029014 12162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:15.029037 12162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.034370 12162 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:35729
I20260811 00:51:15.034451 12382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:35729 every 8 connection(s)
I20260811 00:51:15.034744 12162 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:51:15.040032 11885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.035601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:39465 (local address 127.26.99.190:39389)
0811 00:51:15.035674 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.035677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.035896 (+ 219us) server_negotiation.cc:407] Connection header received
0811 00:51:15.036430 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.036431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.036441 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.036492 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.037156 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.037661 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.038716 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.038910 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.038971 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:15.039735 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.039737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.039737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.039742 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.039756 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.039760 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.039813 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.039940 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.039966 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:51:15.040212 12386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.035554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39389 (local address 127.26.99.130:39465)
0811 00:51:15.035782 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:15.035816 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:15.036295 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:15.036545 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:15.036548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:15.036557 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:15.037055 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:15.037060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.037779 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.037780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:15.038599 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:15.038601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.038978 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.038979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:15.039086 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:15.039562 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:15.039563 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:15.039593 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:15.039616 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:15.039850 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:15.039856 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:15.039859 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:51:15.039933 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 00:51:15.040016 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":111,"threads_started":1}
I20260811 00:51:15.040673 12383 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39389
I20260811 00:51:15.040764 12383 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:15.040908 12383 heartbeater.cc:511] Master 127.26.99.190:39389 requested a full tablet report, sending...
I20260811 00:51:15.041254 11824 ts_manager.cc:194] Registered new tserver with Master: bbd4005acda94611acb4849e32fa959b (127.26.99.130:35729)
I20260811 00:51:15.041596 11824 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.130:39465
I20260811 00:51:15.044322 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 12162
I20260811 00:51:15.044445 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:51:15.044592 27022 external_mini_cluster.cc:1428] Setting key c93bcd5bd588a631e60ad0c41275eafd
I20260811 00:51:15.045470 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--builtin_ntp_servers=127.26.99.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 00:51:15.127214 12387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:15.127420 12387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:15.127449 12387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:15.128736 12387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:15.128774 12387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:15.128808 12387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:51:15.130332 12387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39389
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:15.130600 12387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:15.130887 12387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:15.135607 12398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.135706 12400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.135782 12397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.135842 12387 server_base.cc:1034] running on GCE node
I20260811 00:51:15.136041 12387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:15.136250 12387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:15.137394 12387 hybrid_clock.cc:648] HybridClock initialized: now 1786409475137382 us; error 26 us; skew 500 ppm
I20260811 00:51:15.138641 12387 webserver.cc:460] Webserver started at http://127.26.99.131:33195/ using document root <none> and password file <none>
I20260811 00:51:15.138850 12387 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.138899 12387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.139026 12387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.140113 12387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "6c7cd5ac93ec41eaa232170cde0291ed"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f9ba55206c66ad673f3edb215664778b"
server_key_iv: "431552d34190355f522f143cc709d8dd"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.140522 12387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "6c7cd5ac93ec41eaa232170cde0291ed"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f9ba55206c66ad673f3edb215664778b"
server_key_iv: "431552d34190355f522f143cc709d8dd"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.141808 12387 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:51:15.142436 12408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.142585 12387 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:51:15.142669 12387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "6c7cd5ac93ec41eaa232170cde0291ed"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f9ba55206c66ad673f3edb215664778b"
server_key_iv: "431552d34190355f522f143cc709d8dd"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.142727 12387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.154210 12387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.154495 12387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.154627 12387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.154836 12387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:15.155138 12387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:15.155171 12387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.155197 12387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:15.155220 12387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.161087 12387 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:42099
I20260811 00:51:15.161127 12600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:42099 every 8 connection(s)
I20260811 00:51:15.161443 12387 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:51:15.166111 11885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.162080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:47269 (local address 127.26.99.190:39389)
0811 00:51:15.162123 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.162125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.162351 (+ 226us) server_negotiation.cc:407] Connection header received
0811 00:51:15.162853 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.162854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.162866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.162913 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.163549 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.164046 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.164994 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.165175 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.165222 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:15.165942 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.165943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.165943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.165947 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.165956 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.165959 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.165987 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.166040 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.166056 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:51:15.166316 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.162074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39389 (local address 127.26.99.131:47269)
0811 00:51:15.162235 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:15.162266 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:15.162763 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:15.162972 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:15.162975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:15.162983 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:15.163474 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:15.163478 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.164110 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.164111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:15.164934 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:15.164937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:15.165230 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:15.165230 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:15.165333 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:15.165826 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:15.165827 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:15.165855 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:15.165879 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:15.165990 (+ 111us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:15.165992 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:15.165994 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:51:15.166038 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:51:15.166114 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260811 00:51:15.166761 12604 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39389
I20260811 00:51:15.166846 12604 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:15.166993 12604 heartbeater.cc:511] Master 127.26.99.190:39389 requested a full tablet report, sending...
I20260811 00:51:15.167342 11824 ts_manager.cc:194] Registered new tserver with Master: 6c7cd5ac93ec41eaa232170cde0291ed (127.26.99.131:42099)
I20260811 00:51:15.167670 11824 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.131:47269
I20260811 00:51:15.170656 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 12387
I20260811 00:51:15.170737 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:51:15.170897 27022 external_mini_cluster.cc:1428] Setting key d3907f0a464c874d1514f10b7c4e5da1
I20260811 00:51:15.171705 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 00:51:15.173507 11885 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:15.173038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.26.99.190:39389)
0811 00:51:15.173080 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.173082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.173200 (+ 118us) server_negotiation.cc:407] Connection header received
0811 00:51:15.173261 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.173262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.173271 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.173316 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.173446 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40646: BlockingRecv error: recv got EOF from 127.0.0.1:40646 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:51:15.173547 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 11920
I20260811 00:51:15.203828 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 12162
I20260811 00:51:15.219525 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 12387
I20260811 00:51:15.243633 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 11770
2026-08-11T00:51:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (654 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T00:51:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:51:15Z Disabled control of system clock
I20260811 00:51:15.276741 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40763
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:51:15.357484 12632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:15.357687 12632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:15.357707 12632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:15.358806 12632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:51:15.358845 12632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:15.358856 12632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:15.358867 12632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:51:15.358878 12632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:51:15.360174 12632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:40763
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:15.360422 12632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:15.360692 12632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:15.365109 12644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.365248 12642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.365352 12632 server_base.cc:1034] running on GCE node
W20260811 00:51:15.365387 12638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.365635 12632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:15.365893 12632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:15.367031 12632 hybrid_clock.cc:648] HybridClock initialized: now 1786409475367013 us; error 34 us; skew 500 ppm
I20260811 00:51:15.368245 12632 webserver.cc:460] Webserver started at http://127.26.99.190:42897/ using document root <none> and password file <none>
I20260811 00:51:15.368474 12632 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.368532 12632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.368666 12632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.369678 12632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "189c1784285c59d0c64574037787cf39"
server_key_iv: "cad2211d97924f7a2309ff4f5df837b2"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.370014 12632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "189c1784285c59d0c64574037787cf39"
server_key_iv: "cad2211d97924f7a2309ff4f5df837b2"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.371269 12632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:51:15.371997 12654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.372152 12632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:15.372236 12632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "189c1784285c59d0c64574037787cf39"
server_key_iv: "cad2211d97924f7a2309ff4f5df837b2"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.372301 12632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.375432 12632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.375672 12632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.375787 12632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.379573 12632 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:40763
I20260811 00:51:15.379611 12748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:40763 every 8 connection(s)
I20260811 00:51:15.379899 12632 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:51:15.380573 12749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:15.380826 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 12632
I20260811 00:51:15.380900 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:51:15.381067 27022 external_mini_cluster.cc:1428] Setting key 32b63dae027673faec6f5e295dade513
I20260811 00:51:15.383639 12753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.381545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44546 (local address 127.26.99.190:40763)
0811 00:51:15.381738 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.381747 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.381779 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:51:15.382466 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.382476 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.382531 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.382673 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.383242 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.383246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.383246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.383250 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.383294 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.383306 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.383376 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.383413 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.383468 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260811 00:51:15.384188 12749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9: Bootstrap starting.
I20260811 00:51:15.384802 12749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:15.385056 12749 log.cc:824] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:15.385656 12749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9: No bootstrap required, opened a new log
I20260811 00:51:15.386916 12749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } }
I20260811 00:51:15.387041 12749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:15.387074 12749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 029ff0aaaa9e4cf2a4f2a079f7344fb9, State: Initialized, Role: FOLLOWER
I20260811 00:51:15.387189 12749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } }
I20260811 00:51:15.387250 12749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:51:15.387281 12749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:51:15.387326 12749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:15.387885 12749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } }
I20260811 00:51:15.387979 12749 leader_election.cc:302] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 029ff0aaaa9e4cf2a4f2a079f7344fb9; no voters:
I20260811 00:51:15.388121 12749 leader_election.cc:288] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:51:15.388329 12749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:51:15.388423 12755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:51:15.388545 12755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [term 1 LEADER]: Becoming Leader. State: Replica: 029ff0aaaa9e4cf2a4f2a079f7344fb9, State: Running, Role: LEADER
I20260811 00:51:15.388710 12755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } }
I20260811 00:51:15.389173 12757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 029ff0aaaa9e4cf2a4f2a079f7344fb9. Latest consensus state: current_term: 1 leader_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } } }
I20260811 00:51:15.389155 12756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "029ff0aaaa9e4cf2a4f2a079f7344fb9" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40763 } } }
I20260811 00:51:15.389258 12757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:15.389263 12756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9 [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:15.389453 12769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:51:15.389931 12769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:51:15.391229 12769 catalog_manager.cc:1347] Generated new cluster ID: b58d8ad35522405987e688d652a9af5c
I20260811 00:51:15.391279 12769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:51:15.420459 12769 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:51:15.420634 12769 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:51:15.425836 12769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 029ff0aaaa9e4cf2a4f2a079f7344fb9: Generated new TSK 0
I20260811 00:51:15.426026 12769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:51:15.428251 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--builtin_ntp_servers=127.26.99.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:51:15.508893 12780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:15.509095 12780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:15.509116 12780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:15.510222 12780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:15.510254 12780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:15.510278 12780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:51:15.511560 12780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:15.511740 12780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:15.511982 12780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:15.516719 12796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.516691 12794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.516682 12792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.516842 12780 server_base.cc:1034] running on GCE node
I20260811 00:51:15.517088 12780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:15.517313 12780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:15.518463 12780 hybrid_clock.cc:648] HybridClock initialized: now 1786409475518449 us; error 29 us; skew 500 ppm
I20260811 00:51:15.519629 12780 webserver.cc:460] Webserver started at http://127.26.99.129:42267/ using document root <none> and password file <none>
I20260811 00:51:15.519843 12780 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.519891 12780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.520022 12780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.521113 12780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "290f009926e74f8fae169a8a9e88eef9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f27e045b844c733cbfd234197f97560e"
server_key_iv: "ace430bb93c6a2219bb246a959ab9b88"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.521461 12780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "290f009926e74f8fae169a8a9e88eef9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f27e045b844c733cbfd234197f97560e"
server_key_iv: "ace430bb93c6a2219bb246a959ab9b88"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.522758 12780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:51:15.523433 12802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.523581 12780 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:51:15.523666 12780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "290f009926e74f8fae169a8a9e88eef9"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "f27e045b844c733cbfd234197f97560e"
server_key_iv: "ace430bb93c6a2219bb246a959ab9b88"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.523732 12780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.526885 12780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.527107 12780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.527221 12780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.527396 12780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:15.527685 12780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:15.527719 12780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.527743 12780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:15.527768 12780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.532953 12780 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:33949
I20260811 00:51:15.533030 12995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:33949 every 8 connection(s)
I20260811 00:51:15.533272 12780 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:51:15.535990 12753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.533973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:38515 (local address 127.26.99.190:40763)
0811 00:51:15.534029 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.534031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.534240 (+ 209us) server_negotiation.cc:407] Connection header received
0811 00:51:15.534669 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.534671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.534676 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.534725 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.535801 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.535803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.535803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.535807 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.535823 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.535827 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.535878 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.535927 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.535938 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:51:15.536146 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.533930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40763 (local address 127.26.99.129:38515)
0811 00:51:15.534130 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:15.534168 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:15.534594 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:15.534782 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:15.534785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:15.534792 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:15.535650 (+ 858us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:15.535651 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:15.535677 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:15.535704 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:15.535882 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:15.535884 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:15.535886 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:51:15.535932 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:51:15.535976 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260811 00:51:15.536581 12996 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40763
I20260811 00:51:15.536662 12996 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:15.536772 12996 heartbeater.cc:511] Master 127.26.99.190:40763 requested a full tablet report, sending...
I20260811 00:51:15.537222 12685 ts_manager.cc:194] Registered new tserver with Master: 290f009926e74f8fae169a8a9e88eef9 (127.26.99.129:33949)
I20260811 00:51:15.543485 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 12780
I20260811 00:51:15.543558 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:51:15.543695 27022 external_mini_cluster.cc:1428] Setting key d8542e71ae66591695f81e3355bd7c24
I20260811 00:51:15.544519 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--builtin_ntp_servers=127.26.99.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:51:15.625598 13001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:15.625805 13001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:15.625826 13001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:15.627051 13001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:15.627103 13001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:15.627140 13001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:51:15.628548 13001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:15.628777 13001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:15.629069 13001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:15.634104 13016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.634204 13017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.634315 13021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.634217 13001 server_base.cc:1034] running on GCE node
I20260811 00:51:15.634537 13001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:15.634778 13001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:15.635941 13001 hybrid_clock.cc:648] HybridClock initialized: now 1786409475635924 us; error 30 us; skew 500 ppm
I20260811 00:51:15.637280 13001 webserver.cc:460] Webserver started at http://127.26.99.130:46227/ using document root <none> and password file <none>
I20260811 00:51:15.637511 13001 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.637559 13001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.637688 13001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.638790 13001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "70855b463d254d6884fb161bcace697f"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "35e49460df09503b5213e6dbd9b8e53f"
server_key_iv: "c84f331fdf9421f1e70ca94d457dcabe"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.639137 13001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "70855b463d254d6884fb161bcace697f"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "35e49460df09503b5213e6dbd9b8e53f"
server_key_iv: "c84f331fdf9421f1e70ca94d457dcabe"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.640522 13001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:51:15.641346 13033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.641520 13001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:51:15.641609 13001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "70855b463d254d6884fb161bcace697f"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "35e49460df09503b5213e6dbd9b8e53f"
server_key_iv: "c84f331fdf9421f1e70ca94d457dcabe"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.641680 13001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.644984 13001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.645216 13001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.645339 13001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.645537 13001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:15.645817 13001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:15.645849 13001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.645869 13001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:15.645891 13001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.651513 13001 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:44533
I20260811 00:51:15.651557 13231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:44533 every 8 connection(s)
I20260811 00:51:15.651882 13001 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:51:15.655038 12753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.652759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:59511 (local address 127.26.99.190:40763)
0811 00:51:15.652843 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.652845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.653089 (+ 244us) server_negotiation.cc:407] Connection header received
0811 00:51:15.653583 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.653585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.653592 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.653644 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.654798 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.654800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.654801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.654805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.654822 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.654826 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.654877 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.654952 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.654965 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 00:51:15.655263 13234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.652759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40763 (local address 127.26.99.130:59511)
0811 00:51:15.652970 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:15.653005 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:15.653480 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:15.653713 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:15.653716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:15.653725 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:15.654623 (+ 898us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:15.654624 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:15.654654 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:15.654705 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:15.654882 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:15.654888 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:15.654891 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:51:15.654959 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 00:51:15.655020 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":81,"threads_started":1}
I20260811 00:51:15.655714 13232 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40763
I20260811 00:51:15.655797 13232 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:15.655941 13232 heartbeater.cc:511] Master 127.26.99.190:40763 requested a full tablet report, sending...
I20260811 00:51:15.656280 12685 ts_manager.cc:194] Registered new tserver with Master: 70855b463d254d6884fb161bcace697f (127.26.99.130:44533)
I20260811 00:51:15.659464 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 13001
I20260811 00:51:15.659543 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:51:15.659678 27022 external_mini_cluster.cc:1428] Setting key 1fcebe4af5237a117839ccf1f392cf15
I20260811 00:51:15.661032 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--builtin_ntp_servers=127.26.99.148:38427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 00:51:15.744470 13238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:15.744663 13238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:15.744691 13238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:15.745853 13238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:15.745890 13238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:15.745924 13238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:51:15.747241 13238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:38427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:15.747476 13238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:15.747741 13238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:15.752429 13245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.752439 13249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:15.752498 13246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:15.752544 13238 server_base.cc:1034] running on GCE node
I20260811 00:51:15.752841 13238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:15.753054 13238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:15.754199 13238 hybrid_clock.cc:648] HybridClock initialized: now 1786409475754188 us; error 28 us; skew 500 ppm
I20260811 00:51:15.755317 13238 webserver.cc:460] Webserver started at http://127.26.99.131:43367/ using document root <none> and password file <none>
I20260811 00:51:15.755537 13238 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:15.755589 13238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:15.755717 13238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:15.756770 13238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "d936a607fdf14d05ba086b6f50f44a06"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "88bec2c36bb0837e76ce4df36e843167"
server_key_iv: "62d66195f4485b6386b9aefc2722d613"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.757095 13238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "d936a607fdf14d05ba086b6f50f44a06"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "88bec2c36bb0837e76ce4df36e843167"
server_key_iv: "62d66195f4485b6386b9aefc2722d613"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.758317 13238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:51:15.758978 13266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.759126 13238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:15.759209 13238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "d936a607fdf14d05ba086b6f50f44a06"
format_stamp: "Formatted at 2026-08-11 00:51:15 on dist-test-slave-xt4k"
server_key: "88bec2c36bb0837e76ce4df36e843167"
server_key_iv: "62d66195f4485b6386b9aefc2722d613"
server_key_version: "encryptionkey@0"
I20260811 00:51:15.759269 13238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:15.762449 13238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:15.762672 13238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:15.762789 13238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:15.762977 13238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:15.763262 13238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:15.763300 13238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.763325 13238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:15.763351 13238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:15.768745 13238 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:34267
I20260811 00:51:15.768810 13474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:34267 every 8 connection(s)
I20260811 00:51:15.769078 13238 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:51:15.771651 12753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.769697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:33897 (local address 127.26.99.190:40763)
0811 00:51:15.769771 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.769774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.769943 (+ 169us) server_negotiation.cc:407] Connection header received
0811 00:51:15.770375 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.770377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.770382 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.770430 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.771485 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:15.771486 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:15.771486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:51:15.771488 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:15.771498 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:51:15.771501 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:15.771533 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:15.771589 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 00:51:15.771599 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:51:15.771811 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:15.769671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40763 (local address 127.26.99.131:33897)
0811 00:51:15.769839 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:15.769869 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:15.770296 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:15.770481 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:15.770484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:15.770492 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:15.771365 (+ 873us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:51:15.771365 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:15.771392 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:51:15.771419 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:15.771538 (+ 119us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:15.771540 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:15.771543 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:51:15.771591 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:51:15.771636 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260811 00:51:15.772182 13477 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40763
I20260811 00:51:15.772259 13477 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:15.772404 13477 heartbeater.cc:511] Master 127.26.99.190:40763 requested a full tablet report, sending...
I20260811 00:51:15.772725 12685 ts_manager.cc:194] Registered new tserver with Master: d936a607fdf14d05ba086b6f50f44a06 (127.26.99.131:34267)
I20260811 00:51:15.777557 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 13238
I20260811 00:51:15.777634 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:51:15.777793 27022 external_mini_cluster.cc:1428] Setting key a294e8e9419aa9545ce467d944ae1b4d
I20260811 00:51:15.778584 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 00:51:15.780407 12753 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:51:15.779983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.26.99.190:40763)
0811 00:51:15.780029 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:15.780031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:15.780140 (+ 109us) server_negotiation.cc:407] Connection header received
0811 00:51:15.780184 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:15.780185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:15.780188 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:15.780235 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:15.780355 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44560: BlockingRecv error: recv got EOF from 127.0.0.1:44560 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:51:15.780515 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 12780
I20260811 00:51:15.795979 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 13001
I20260811 00:51:15.805968 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 13238
I20260811 00:51:15.817167 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 12632
2026-08-11T00:51:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (573 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:51:15 dist-test-slave-xt4k krb5kdc[13492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:51:15 dist-test-slave-xt4k krb5kdc[13492](info): set up 2 sockets
Aug 11 00:51:15 dist-test-slave-xt4k krb5kdc[13492](info): commencing operation
krb5kdc: starting...
W20260811 00:51:17.008816 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:51:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:51:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:51:17.122612 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39651
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:39651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:51:17.202737 13517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:17.202919 13517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:17.202940 13517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:17.204025 13517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:51:17.204071 13517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:17.204084 13517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:17.204097 13517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:51:17.204107 13517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:51:17.205540 13517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:39651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:17.205757 13517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:17.205955 13517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:17.210457 13533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:17.210458 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.210597 13517 server_base.cc:1034] running on GCE node
W20260811 00:51:17.210536 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.210882 13517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:17.211143 13517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:17.212287 13517 hybrid_clock.cc:648] HybridClock initialized: now 1786409477212266 us; error 38 us; skew 500 ppm
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:51:17.214571 13517 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:51:17.214936 13517 webserver.cc:460] Webserver started at http://127.26.99.190:38095/ using document root <none> and password file <none>
I20260811 00:51:17.215099 13517 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:17.215137 13517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:17.215222 13517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:17.216140 13517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "436492a6f9d5498a8abf71507857cc6e"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "3e304625f6387dee1b022d278547ee95"
server_key_iv: "45d4db4e4650e045ff454275b9d9cb2d"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.216483 13517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "436492a6f9d5498a8abf71507857cc6e"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "3e304625f6387dee1b022d278547ee95"
server_key_iv: "45d4db4e4650e045ff454275b9d9cb2d"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.217623 13517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:51:17.218245 13543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.218380 13517 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:51:17.218475 13517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "436492a6f9d5498a8abf71507857cc6e"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "3e304625f6387dee1b022d278547ee95"
server_key_iv: "45d4db4e4650e045ff454275b9d9cb2d"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.218537 13517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:17.273123 13517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:17.274998 13517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:17.275126 13517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:17.279101 13517 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:39651
I20260811 00:51:17.279146 13643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:39651 every 8 connection(s)
I20260811 00:51:17.279487 13517 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:51:17.280503 13644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:17.282903 13644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: Bootstrap starting.
I20260811 00:51:17.283468 13644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:17.283723 13644 log.cc:824] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:17.284459 13644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: No bootstrap required, opened a new log
I20260811 00:51:17.286072 13644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } }
I20260811 00:51:17.286214 13644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:17.286247 13644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436492a6f9d5498a8abf71507857cc6e, State: Initialized, Role: FOLLOWER
I20260811 00:51:17.286392 13644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } }
I20260811 00:51:17.286473 13644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:51:17.286506 13644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:51:17.286556 13644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:17.287343 13644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } }
I20260811 00:51:17.287382 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 13517
I20260811 00:51:17.287456 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:51:17.287444 13644 leader_election.cc:302] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 436492a6f9d5498a8abf71507857cc6e; no voters:
I20260811 00:51:17.287597 13644 leader_election.cc:288] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:51:17.287645 27022 external_mini_cluster.cc:1428] Setting key 141a6c0fdc1257c43128070daf6dc4bf
I20260811 00:51:17.287633 13650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:51:17.287762 13650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [term 1 LEADER]: Becoming Leader. State: Replica: 436492a6f9d5498a8abf71507857cc6e, State: Running, Role: LEADER
I20260811 00:51:17.287869 13644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:51:17.287914 13650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } }
I20260811 00:51:17.288661 13654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 436492a6f9d5498a8abf71507857cc6e. Latest consensus state: current_term: 1 leader_uuid: "436492a6f9d5498a8abf71507857cc6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } } }
I20260811 00:51:17.288754 13654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:17.289062 13651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "436492a6f9d5498a8abf71507857cc6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "436492a6f9d5498a8abf71507857cc6e" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39651 } } }
I20260811 00:51:17.289136 13651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e [sys.catalog]: This master's current role is: LEADER
I20260811 00:51:17.289382 13667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:51:17.290105 13667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:51:17.291479 13667 catalog_manager.cc:1347] Generated new cluster ID: 66a632fe95b04d14b868f252047ff2fe
I20260811 00:51:17.291533 13667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:51:17.299881 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.288165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39284 (local address 127.26.99.190:39651)
0811 00:51:17.288392 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.288402 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.288433 (+ 31us) server_negotiation.cc:407] Connection header received
0811 00:51:17.288548 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.288555 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.288624 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.289572 (+ 948us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:17.289674 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.291018 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.291985 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.292639 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.292752 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.295525 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:17.295529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:17.295529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:51:17.295543 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:17.298225 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.298626 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.298629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.298629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.298763 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.298962 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.298963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.298963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.299268 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:17.299411 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.299515 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.299648 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":101,"threads_started":1}
I20260811 00:51:17.307619 13667 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:51:17.308379 13667 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:51:17.315416 13667 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: Generated new TSK 0
I20260811 00:51:17.315645 13667 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:51:17.345466 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:51:17.426560 13685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:17.426748 13685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:17.426774 13685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:17.427912 13685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:17.427951 13685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:17.427975 13685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:51:17.429481 13685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:17.429706 13685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:17.429924 13685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:17.434787 13693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:17.434729 13694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:17.434733 13698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.435042 13685 server_base.cc:1034] running on GCE node
I20260811 00:51:17.435251 13685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:17.435461 13685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:17.436594 13685 hybrid_clock.cc:648] HybridClock initialized: now 1786409477436583 us; error 25 us; skew 500 ppm
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:51:17.442783 13685 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:51:17.443248 13685 webserver.cc:460] Webserver started at http://127.26.99.129:33177/ using document root <none> and password file <none>
I20260811 00:51:17.443495 13685 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:17.443554 13685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:17.443686 13685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:17.444756 13685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "3bd9530dcdef43348ca3fb8f7091494d"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "f400c89cdc729eafc95b546a7ef5a972"
server_key_iv: "9951e7d488dae9946e32e4a71b00c464"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.445087 13685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "3bd9530dcdef43348ca3fb8f7091494d"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "f400c89cdc729eafc95b546a7ef5a972"
server_key_iv: "9951e7d488dae9946e32e4a71b00c464"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.446280 13685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:51:17.446939 13707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.447086 13685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:17.447168 13685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "3bd9530dcdef43348ca3fb8f7091494d"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "f400c89cdc729eafc95b546a7ef5a972"
server_key_iv: "9951e7d488dae9946e32e4a71b00c464"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.447233 13685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:17.465728 13685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:17.467698 13685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:17.467842 13685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:17.468070 13685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:17.468411 13685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:17.468452 13685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.468492 13685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:17.468516 13685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.474098 13685 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:37863
I20260811 00:51:17.474153 13902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:37863 every 8 connection(s)
I20260811 00:51:17.474455 13685 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:51:17.480918 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 13685
I20260811 00:51:17.481024 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:51:17.481190 27022 external_mini_cluster.cc:1428] Setting key de2ae2b6f658b485e3717e4054df8358
I20260811 00:51:17.484022 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.475174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:60783 (local address 127.26.99.190:39651)
0811 00:51:17.475233 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.475235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.475363 (+ 128us) server_negotiation.cc:407] Connection header received
0811 00:51:17.475856 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.475857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.475870 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.475941 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:17.476940 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.477469 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.478491 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.478706 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.478776 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.481071 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:17.481072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:17.481073 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:51:17.481081 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:17.482588 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.483039 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.483040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.483041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.483099 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.483359 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.483359 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.483360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.483470 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:17.483526 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.483843 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.483933 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 00:51:17.484200 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.475092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39651 (local address 127.26.99.129:60783)
0811 00:51:17.475247 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.475290 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.475774 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.476011 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.476015 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.476621 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:17.476821 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.476826 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.477582 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.477583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.478394 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.478396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.478796 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.478798 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.478942 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.479404 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:17.479413 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:17.480955 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:17.482680 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.482687 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.482690 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.482965 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.483160 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.483161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.483161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.483294 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.483526 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:17.483532 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:17.483700 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.483812 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.483983 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260811 00:51:17.484761 13904 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39651
I20260811 00:51:17.484846 13904 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:17.485023 13904 heartbeater.cc:511] Master 127.26.99.190:39651 requested a full tablet report, sending...
I20260811 00:51:17.485562 13574 ts_manager.cc:194] Registered new tserver with Master: 3bd9530dcdef43348ca3fb8f7091494d (127.26.99.129:37863)
I20260811 00:51:17.486426 13574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:60783
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:51:17.507009 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:51:17.586593 13912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:17.586779 13912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:17.586799 13912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:17.587846 13912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:17.587877 13912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:17.587908 13912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:51:17.589419 13912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:17.589591 13912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:17.589756 13912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:17.594480 13919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.594561 13912 server_base.cc:1034] running on GCE node
W20260811 00:51:17.594470 13923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:17.594480 13920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.594897 13912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:17.595094 13912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:17.596252 13912 hybrid_clock.cc:648] HybridClock initialized: now 1786409477596230 us; error 29 us; skew 500 ppm
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:51:17.598630 13912 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:51:17.599035 13912 webserver.cc:460] Webserver started at http://127.26.99.130:37609/ using document root <none> and password file <none>
I20260811 00:51:17.599231 13912 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:17.599277 13912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:17.599406 13912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:17.600430 13912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "6df3a763a1214e5fb37be0b15ad83749"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "a5a13583e99b33bfba5b35841f6d2823"
server_key_iv: "d3dcbcb710b656a8df182f57b3bbe078"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.600750 13912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "6df3a763a1214e5fb37be0b15ad83749"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "a5a13583e99b33bfba5b35841f6d2823"
server_key_iv: "d3dcbcb710b656a8df182f57b3bbe078"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.601984 13912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:51:17.602739 13935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.603665 13912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:51:17.603762 13912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "6df3a763a1214e5fb37be0b15ad83749"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "a5a13583e99b33bfba5b35841f6d2823"
server_key_iv: "d3dcbcb710b656a8df182f57b3bbe078"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.603847 13912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:17.635756 13912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:17.638608 13912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:17.638753 13912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:17.639052 13912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:17.639408 13912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:17.639446 13912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.639474 13912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:17.639499 13912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.646971 13912 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:34769
I20260811 00:51:17.647019 14148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:34769 every 8 connection(s)
I20260811 00:51:17.647413 13912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:51:17.654556 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 13912
I20260811 00:51:17.654666 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:51:17.654862 27022 external_mini_cluster.cc:1428] Setting key 8f8b1fa9c3b1199590711fae35470209
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:51:17.658771 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.648260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:34421 (local address 127.26.99.190:39651)
0811 00:51:17.648319 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.648321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.648541 (+ 220us) server_negotiation.cc:407] Connection header received
0811 00:51:17.649046 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.649047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.649061 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.649119 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:17.650405 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.651240 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.652682 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.652996 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.653061 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.655431 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:17.655433 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:17.655433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:51:17.655443 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:17.657487 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.657848 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.657849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.657849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.657909 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.658136 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.658137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.658138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.658254 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:17.658311 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.658577 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.658676 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:51:17.659041 14152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.648230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39651 (local address 127.26.99.130:34421)
0811 00:51:17.648426 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.648464 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.648954 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.649226 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.649231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.650019 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:17.650300 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.650307 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.651328 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.651329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.652582 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.652585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.653073 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.653074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.653215 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.653729 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:17.653739 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:17.655342 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:17.657561 (+ 2219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.657568 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.657570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.657782 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.657965 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.657973 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.657973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.658080 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.658308 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:17.658315 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:17.658455 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.658602 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.658792 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":120,"threads_started":1}
I20260811 00:51:17.659446 14150 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39651
I20260811 00:51:17.659544 14150 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:17.659718 14150 heartbeater.cc:511] Master 127.26.99.190:39651 requested a full tablet report, sending...
I20260811 00:51:17.660094 13574 ts_manager.cc:194] Registered new tserver with Master: 6df3a763a1214e5fb37be0b15ad83749 (127.26.99.130:34769)
I20260811 00:51:17.660549 13574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:34421
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:51:17.681515 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:51:17.764521 14156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:51:17.764722 14156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:51:17.764744 14156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:51:17.765801 14156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:51:17.765843 14156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:51:17.765867 14156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:51:17.767261 14156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:51:17.767442 14156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:51:17.767616 14156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:51:17.772444 14170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.772534 14156 server_base.cc:1034] running on GCE node
W20260811 00:51:17.772485 14168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:51:17.772496 14164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:51:17.772874 14156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:51:17.773111 14156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:51:17.774266 14156 hybrid_clock.cc:648] HybridClock initialized: now 1786409477774251 us; error 27 us; skew 500 ppm
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:51:17.776820 14156 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:51:17.777256 14156 webserver.cc:460] Webserver started at http://127.26.99.131:46139/ using document root <none> and password file <none>
I20260811 00:51:17.777451 14156 fs_manager.cc:359] Metadata directory not provided
I20260811 00:51:17.777498 14156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:51:17.777626 14156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:51:17.778646 14156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "28854aacd6de4b37a603aacc82aa9376"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "2630e46579669b8d2718be67d4adf673"
server_key_iv: "0a95574d83768c75f081a9ffdfa0a33c"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.778975 14156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "28854aacd6de4b37a603aacc82aa9376"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "2630e46579669b8d2718be67d4adf673"
server_key_iv: "0a95574d83768c75f081a9ffdfa0a33c"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.780212 14156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:51:17.780967 14190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.781126 14156 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:51:17.781217 14156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "28854aacd6de4b37a603aacc82aa9376"
format_stamp: "Formatted at 2026-08-11 00:51:17 on dist-test-slave-xt4k"
server_key: "2630e46579669b8d2718be67d4adf673"
server_key_iv: "0a95574d83768c75f081a9ffdfa0a33c"
server_key_version: "encryptionkey@0"
I20260811 00:51:17.781287 14156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:51:17.791014 14156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:51:17.793128 14156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:51:17.793262 14156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:51:17.793462 14156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:51:17.793757 14156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:51:17.793790 14156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.793818 14156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:51:17.793843 14156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:51:17.799466 14156 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:33111
I20260811 00:51:17.799543 14401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:33111 every 8 connection(s)
I20260811 00:51:17.799805 14156 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:51:17 dist-test-slave-xt4k krb5kdc[13492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409477, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:51:17.806890 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 14156
I20260811 00:51:17.806972 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:51:17.807118 27022 external_mini_cluster.cc:1428] Setting key 0c1ace4f534cb1a70d32944dfe87dc59
I20260811 00:51:17.808715 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.800545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:52365 (local address 127.26.99.190:39651)
0811 00:51:17.800603 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.800605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.800782 (+ 177us) server_negotiation.cc:407] Connection header received
0811 00:51:17.801255 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.801256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.801266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.801311 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:17.802190 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.802693 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.803617 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.803793 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.803837 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.805914 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:17.805916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:17.805916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:51:17.805923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:17.807267 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.807712 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.807714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.807714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.807778 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.808050 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.808051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.808051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.808209 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:17.808266 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.808587 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.808651 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:51:17.808897 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.800526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39651 (local address 127.26.99.131:52365)
0811 00:51:17.800675 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.800715 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.801177 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.801369 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.801372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.801928 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:51:17.802119 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.802124 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.802755 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.802755 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.803556 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.803559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.803877 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.803879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.804003 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.804500 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:51:17.804508 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:51:17.805800 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:51:17.807345 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.807357 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.807359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.807651 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.807838 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:51:17.807838 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:51:17.807839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:51:17.807999 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:51:17.808289 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:51:17.808295 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:51:17.808466 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.808561 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.808698 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260811 00:51:17.809315 14402 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39651
I20260811 00:51:17.809414 14402 heartbeater.cc:464] Registering TS with master...
I20260811 00:51:17.809587 14402 heartbeater.cc:511] Master 127.26.99.190:39651 requested a full tablet report, sending...
I20260811 00:51:17.810272 13574 ts_manager.cc:194] Registered new tserver with Master: 28854aacd6de4b37a603aacc82aa9376 (127.26.99.131:33111)
I20260811 00:51:17.810689 13574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:52365
I20260811 00:51:17.818775 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:51:17.825392 13656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.820037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39300 (local address 127.26.99.190:39651)
0811 00:51:17.820102 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.820104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.820133 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:51:17.820205 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.820206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.820217 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.820262 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:51:17.820844 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.821316 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.822005 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.822188 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.822240 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.823289 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:51:17.823290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:51:17.823290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:51:17.823297 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:51:17.824381 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.824677 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.824678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.824679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.824731 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:51:17.824890 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:51:17.824890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:51:17.824891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:51:17.825037 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:51:17.825124 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.825228 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.825305 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:51:17.826947 13574 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:51:17.828552 13574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:51:17.834785 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:37863 (local address 127.0.0.1:60422)
0811 00:51:17.830993 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.831004 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.831059 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.831346 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.831347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.831348 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:51:17.831595 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.831598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832815 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.832816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.833786 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.833789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.834579 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.834579 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.834637 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.834647 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.834697 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.834733 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":32,"thread_start_us":71,"threads_started":1}
I20260811 00:51:17.834825 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.26.99.129:37863)
0811 00:51:17.831208 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.831212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.831220 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:17.831254 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.831256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.831272 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.831341 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:51:17.831680 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832741 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.833859 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.834490 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.834581 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.834640 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.834710 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.834745 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":93,"threads_started":1}
I20260811 00:51:17.835500 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33111 (local address 127.0.0.1:36674)
0811 00:51:17.831430 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.831440 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.831498 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.831737 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.831738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.831739 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:51:17.831782 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.831783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832679 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.832680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.834035 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.834038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.835263 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.835264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.835325 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.835331 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.835387 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.835428 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":78,"thread_start_us":70,"threads_started":1}
I20260811 00:51:17.835789 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34769 (local address 127.0.0.1:35148)
0811 00:51:17.830966 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.830997 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.831059 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.831327 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.831330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.831332 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:51:17.831397 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.831399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832739 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.832740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.834050 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.834052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.835571 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.835572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.835635 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.835639 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.835682 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.835722 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":106,"thread_start_us":58,"threads_started":1}
I20260811 00:51:17.835556 14428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36674 (local address 127.26.99.131:33111)
0811 00:51:17.831127 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.831132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.831554 (+ 422us) server_negotiation.cc:407] Connection header received
0811 00:51:17.831596 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.831598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.831613 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.831678 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:51:17.831848 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832590 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.834121 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.834801 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.834865 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.834918 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.835423 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.835468 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260811 00:51:17.835681 13794 tablet_service.cc:1467] Processing CreateTablet for tablet c2f441d6133544dea969baf0da3a817a (DEFAULT_TABLE table=test-table [id=92c5bce1e4fe4530ba9a74a26f2e83c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:51:17.835980 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.830826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.26.99.130:34769)
0811 00:51:17.831167 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.831171 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.831182 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:51:17.831221 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.831223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.831239 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.831316 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:51:17.831488 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.832646 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.834953 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.835422 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.835484 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.835534 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.835886 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.835924 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":67,"threads_started":1}
I20260811 00:51:17.836079 13794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f441d6133544dea969baf0da3a817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:17.836391 14281 tablet_service.cc:1467] Processing CreateTablet for tablet c2f441d6133544dea969baf0da3a817a (DEFAULT_TABLE table=test-table [id=92c5bce1e4fe4530ba9a74a26f2e83c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:51:17.836725 14281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f441d6133544dea969baf0da3a817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:17.836977 14024 tablet_service.cc:1467] Processing CreateTablet for tablet c2f441d6133544dea969baf0da3a817a (DEFAULT_TABLE table=test-table [id=92c5bce1e4fe4530ba9a74a26f2e83c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:51:17.837292 14024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2f441d6133544dea969baf0da3a817a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:51:17.839020 14429 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: Bootstrap starting.
I20260811 00:51:17.839650 14429 tablet_bootstrap.cc:654] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:17.840159 14429 log.cc:824] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:17.840267 14432 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Bootstrap starting.
I20260811 00:51:17.840552 14430 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Bootstrap starting.
I20260811 00:51:17.840884 14429 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: No bootstrap required, opened a new log
I20260811 00:51:17.840945 14429 ts_tablet_manager.cc:1397] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 00:51:17.841063 14432 tablet_bootstrap.cc:654] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:17.841177 14430 tablet_bootstrap.cc:654] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Neither blocks nor log segments found. Creating new log.
I20260811 00:51:17.841604 14432 log.cc:824] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:17.841692 14430 log.cc:824] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Log is configured to *not* fsync() on all Append() calls
I20260811 00:51:17.842334 14432 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: No bootstrap required, opened a new log
I20260811 00:51:17.842412 14432 ts_tablet_manager.cc:1397] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:51:17.842620 14429 raft_consensus.cc:348] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.842784 14429 raft_consensus.cc:374] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:17.842809 14429 raft_consensus.cc:729] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd9530dcdef43348ca3fb8f7091494d, State: Initialized, Role: FOLLOWER
I20260811 00:51:17.842919 14429 consensus_queue.cc:260] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.843179 14429 ts_tablet_manager.cc:1428] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:51:17.843204 13904 heartbeater.cc:503] Master 127.26.99.190:39651 was elected leader, sending a full tablet report...
I20260811 00:51:17.844264 14432 raft_consensus.cc:348] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.844460 14432 raft_consensus.cc:374] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:17.844516 14432 raft_consensus.cc:729] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6df3a763a1214e5fb37be0b15ad83749, State: Initialized, Role: FOLLOWER
I20260811 00:51:17.844623 14432 consensus_queue.cc:260] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.844678 14430 tablet_bootstrap.cc:492] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: No bootstrap required, opened a new log
I20260811 00:51:17.844726 14430 ts_tablet_manager.cc:1397] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 00:51:17.844887 14432 ts_tablet_manager.cc:1428] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:51:17.844928 14150 heartbeater.cc:503] Master 127.26.99.190:39651 was elected leader, sending a full tablet report...
I20260811 00:51:17.846294 14430 raft_consensus.cc:348] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.846408 14430 raft_consensus.cc:374] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:51:17.846428 14430 raft_consensus.cc:729] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28854aacd6de4b37a603aacc82aa9376, State: Initialized, Role: FOLLOWER
I20260811 00:51:17.846503 14430 consensus_queue.cc:260] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.846778 14430 ts_tablet_manager.cc:1428] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:51:17.846812 14402 heartbeater.cc:503] Master 127.26.99.190:39651 was elected leader, sending a full tablet report...
W20260811 00:51:17.898039 14151 tablet.cc:2369] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:51:17.908831 14445 raft_consensus.cc:482] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:51:17.908972 14445 raft_consensus.cc:504] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.909300 14445 leader_election.cc:288] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6df3a763a1214e5fb37be0b15ad83749 (127.26.99.130:34769), 28854aacd6de4b37a603aacc82aa9376 (127.26.99.131:33111)
I20260811 00:51:17.912179 14428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.909703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:49059 (local address 127.26.99.131:33111)
0811 00:51:17.909852 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.909854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.909862 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:51:17.909894 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.909895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.909904 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.909949 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:51:17.910079 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.910565 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911479 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.911862 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911926 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.911935 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.912064 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.912102 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 00:51:17.912192 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.909491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34769 (local address 127.26.99.129:44355)
0811 00:51:17.909546 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.909559 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.909603 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.909765 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.909767 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.909769 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:51:17.909841 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.909842 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.910557 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.910558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.911390 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.911392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.911927 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.912012 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.912015 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.912064 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.912102 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":38}
I20260811 00:51:17.912180 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.909552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:44355 (local address 127.26.99.130:34769)
0811 00:51:17.909607 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.909609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.909654 (+ 45us) server_negotiation.cc:407] Connection header received
0811 00:51:17.909684 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.909685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.909694 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.909748 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:51:17.909928 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.910475 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911478 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.911853 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911912 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.911921 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.912078 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.912114 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:51:17.912201 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.909629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33111 (local address 127.26.99.129:49059)
0811 00:51:17.909811 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.909821 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:51:17.909859 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:51:17.909960 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:51:17.909961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:51:17.909963 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:51:17.910025 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.910027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.910638 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.910639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.911395 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:51:17.911397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.911941 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.911942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:51:17.912002 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.912005 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:51:17.912048 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:51:17.912087 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":2,"thread_start_us":132,"threads_started":1}
I20260811 00:51:17.912632 14060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f441d6133544dea969baf0da3a817a" candidate_uuid: "3bd9530dcdef43348ca3fb8f7091494d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df3a763a1214e5fb37be0b15ad83749" is_pre_election: true
I20260811 00:51:17.912684 14312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f441d6133544dea969baf0da3a817a" candidate_uuid: "3bd9530dcdef43348ca3fb8f7091494d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28854aacd6de4b37a603aacc82aa9376" is_pre_election: true
I20260811 00:51:17.912779 14060 raft_consensus.cc:2454] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd9530dcdef43348ca3fb8f7091494d in term 0.
I20260811 00:51:17.912814 14312 raft_consensus.cc:2454] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bd9530dcdef43348ca3fb8f7091494d in term 0.
I20260811 00:51:17.913009 13711 leader_election.cc:302] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bd9530dcdef43348ca3fb8f7091494d, 6df3a763a1214e5fb37be0b15ad83749; no voters:
I20260811 00:51:17.913153 14445 raft_consensus.cc:2781] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:51:17.913209 14445 raft_consensus.cc:482] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:51:17.913232 14445 raft_consensus.cc:3037] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:17.913923 14445 raft_consensus.cc:504] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.914040 14445 leader_election.cc:288] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [CANDIDATE]: Term 1 election: Requested vote from peers 6df3a763a1214e5fb37be0b15ad83749 (127.26.99.130:34769), 28854aacd6de4b37a603aacc82aa9376 (127.26.99.131:33111)
I20260811 00:51:17.914224 14060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f441d6133544dea969baf0da3a817a" candidate_uuid: "3bd9530dcdef43348ca3fb8f7091494d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6df3a763a1214e5fb37be0b15ad83749"
I20260811 00:51:17.914244 14312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2f441d6133544dea969baf0da3a817a" candidate_uuid: "3bd9530dcdef43348ca3fb8f7091494d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28854aacd6de4b37a603aacc82aa9376"
I20260811 00:51:17.914309 14060 raft_consensus.cc:3037] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:17.914307 14312 raft_consensus.cc:3037] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:51:17.914997 14312 raft_consensus.cc:2454] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd9530dcdef43348ca3fb8f7091494d in term 1.
I20260811 00:51:17.915092 14060 raft_consensus.cc:2454] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bd9530dcdef43348ca3fb8f7091494d in term 1.
I20260811 00:51:17.915171 13711 leader_election.cc:302] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28854aacd6de4b37a603aacc82aa9376, 3bd9530dcdef43348ca3fb8f7091494d; no voters:
I20260811 00:51:17.915261 14445 raft_consensus.cc:2781] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:51:17.915429 14445 raft_consensus.cc:686] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [term 1 LEADER]: Becoming Leader. State: Replica: 3bd9530dcdef43348ca3fb8f7091494d, State: Running, Role: LEADER
I20260811 00:51:17.915530 14445 consensus_queue.cc:237] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } }
I20260811 00:51:17.916376 13574 catalog_manager.cc:5495] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bd9530dcdef43348ca3fb8f7091494d (127.26.99.129). New cstate: current_term: 1 leader_uuid: "3bd9530dcdef43348ca3fb8f7091494d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bd9530dcdef43348ca3fb8f7091494d" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 37863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 } health_report { overall_health: UNKNOWN } } }
I20260811 00:51:17.926357 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.924144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.26.99.129:37863)
0811 00:51:17.924194 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:51:17.924195 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:51:17.924201 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:51:17.924227 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:51:17.924227 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:51:17.924241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:51:17.924301 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:51:17.924478 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.924921 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.925637 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:51:17.925820 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:51:17.925873 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:51:17.926030 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:51:17.926132 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:51:17.926204 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 00:51:17.926252 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:51:17.926271 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:51:17.927990 14312 raft_consensus.cc:1261] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 1 FOLLOWER]: Refusing update from remote peer 3bd9530dcdef43348ca3fb8f7091494d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:51:17.927990 14060 raft_consensus.cc:1261] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 1 FOLLOWER]: Refusing update from remote peer 3bd9530dcdef43348ca3fb8f7091494d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:51:17.928370 14451 consensus_queue.cc:1035] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6df3a763a1214e5fb37be0b15ad83749" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:51:17.928496 14445 consensus_queue.cc:1035] T c2f441d6133544dea969baf0da3a817a P 3bd9530dcdef43348ca3fb8f7091494d [LEADER]: Connected to new peer: Peer: permanent_uuid: "28854aacd6de4b37a603aacc82aa9376" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:51:17.931090 14458 mvcc.cc:205] Tried to move back new op lower bound from 7317133221590454272 to 7317133221542592512. Current Snapshot: MvccSnapshot[applied={T|T < 7317133221590454272}]
I20260811 00:51:17.931550 14457 mvcc.cc:205] Tried to move back new op lower bound from 7317133221590454272 to 7317133221542592512. Current Snapshot: MvccSnapshot[applied={T|T < 7317133221590454272}]
I20260811 00:51:17.932927 13569 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:51:17.933028 13569 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:51:17.933779 13569 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 436492a6f9d5498a8abf71507857cc6e: Sending DeleteTablet for 3 replicas of tablet c2f441d6133544dea969baf0da3a817a
I20260811 00:51:17.934111 13794 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f441d6133544dea969baf0da3a817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:51:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:60422
I20260811 00:51:17.934227 14024 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f441d6133544dea969baf0da3a817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:51:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:35148
I20260811 00:51:17.934413 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 13685
I20260811 00:51:17.934450 14281 tablet_service.cc:1514] Processing DeleteTablet for tablet c2f441d6133544dea969baf0da3a817a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:51:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36674
I20260811 00:51:17.945847 14472 tablet_replica.cc:330] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: stopping tablet replica
I20260811 00:51:17.946008 14472 raft_consensus.cc:2229] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:51:17.946128 14472 raft_consensus.cc:2258] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:51:17.947064 14472 ts_tablet_manager.cc:1905] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:51:17.948783 14472 ts_tablet_manager.cc:1918] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:51:17.948906 14472 log.cc:1196] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/c2f441d6133544dea969baf0da3a817a
I20260811 00:51:17.949263 14472 ts_tablet_manager.cc:1939] T c2f441d6133544dea969baf0da3a817a P 6df3a763a1214e5fb37be0b15ad83749: Deleting consensus metadata
I20260811 00:51:17.949874 13546 catalog_manager.cc:4841] TS 6df3a763a1214e5fb37be0b15ad83749 (127.26.99.130:34769): tablet c2f441d6133544dea969baf0da3a817a (table test-table [id=92c5bce1e4fe4530ba9a74a26f2e83c2]) successfully deleted
I20260811 00:51:17.954667 14473 tablet_replica.cc:330] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: stopping tablet replica
I20260811 00:51:17.954829 14473 raft_consensus.cc:2229] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:51:17.954967 14473 raft_consensus.cc:2258] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:51:17.955416 14473 ts_tablet_manager.cc:1905] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:51:17.956957 14473 ts_tablet_manager.cc:1918] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:51:17.957031 14473 log.cc:1196] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/c2f441d6133544dea969baf0da3a817a
I20260811 00:51:17.957263 14473 ts_tablet_manager.cc:1939] T c2f441d6133544dea969baf0da3a817a P 28854aacd6de4b37a603aacc82aa9376: Deleting consensus metadata
I20260811 00:51:17.957715 13546 catalog_manager.cc:4841] TS 28854aacd6de4b37a603aacc82aa9376 (127.26.99.131:33111): tablet c2f441d6133544dea969baf0da3a817a (table test-table [id=92c5bce1e4fe4530ba9a74a26f2e83c2]) successfully deleted
W20260811 00:51:17.958779 13545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:37863 (error 108)
I20260811 00:51:17.958895 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 13912
I20260811 00:51:17.961594 14419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:51:17.961421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:37863 (local address 127.0.0.1:60438)
0811 00:51:17.961494 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 00:51:17.961551 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:37863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 00:51:17.961824 13545 catalog_manager.cc:4584] TS 3bd9530dcdef43348ca3fb8f7091494d (127.26.99.129:37863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2f441d6133544dea969baf0da3a817a: Network error: Client connection negotiation failed: client connection to 127.26.99.129:37863: connect: Connection refused (error 111)
I20260811 00:51:17.981902 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 14156
I20260811 00:51:17.991701 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 13517
2026-08-11T00:51:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2176 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:51:18 dist-test-slave-xt4k krb5kdc[14482](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:51:18 dist-test-slave-xt4k krb5kdc[14482](info): set up 2 sockets
Aug 11 00:51:18 dist-test-slave-xt4k krb5kdc[14482](info): commencing operation
krb5kdc: starting...
W20260811 00:51:19.186637 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:51:19 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:51:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangeradmin_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangeradmin_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangerlookup_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangerlookup_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
I20260811 00:51:19.345052 27022 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task7ONN3e/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/postgres -l logfile start
2026-08-11 00:51:21.757 UTC [14538] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 00:51:21.758 UTC [14538] LOG: listening on IPv4 address "127.26.99.148", port 58823
2026-08-11 00:51:21.761 UTC [14538] LOG: listening on Unix socket "/tmp/.s.PGSQL.58823"
2026-08-11 00:51:21.786 UTC [14542] LOG: database system was shut down at 2026-08-11 00:51:20 UTC
2026-08-11 00:51:21.789 UTC [14538] LOG: database system is ready to accept connections
I20260811 00:51:22.888641 27022 mini_postgres.cc:96] Postgres bound to 58823
2026-08-11 00:51:22.896 UTC [14556] FATAL: database "slave" does not exist
127.26.99.148:58823 - accepting connections
I20260811 00:51:22.897360 27022 mini_ranger.cc:161] Starting Ranger...
I20260811 00:51:22.913514 27022 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 00:51:23.357563 27022 mini_ranger.cc:87] Created ranger Postgres database
I20260811 00:51:23.357646 27022 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin
2026-08-11 00:51:23,760 [I] DB FLAVOR :POSTGRES
2026-08-11 00:51:23,760 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:51:23,761 [I] Checking connection..
2026-08-11 00:51:23,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 00:51:24,047 [I] Checking connection passed.
2026-08-11 00:51:24,048 [I] --------- Verifying version history table ---------
2026-08-11 00:51:24,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:51:24,292 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:51:24,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:51:24,551 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:51:24,552 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 00:51:24,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 00:51:24.814 UTC [14669] WARNING: there is no transaction in progress
2026-08-11 00:51:24,824 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 00:51:24,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:51:25,075 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 00:51:25,076 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:51:25,076 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 00:51:25,320 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 00:51:25,579 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xt4k.c.gcp-upstream.internal','N') ;"
2026-08-11 00:51:25,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:51:26,064 [I] Table x_portal_user does not exist in database ranger
2026-08-11 00:51:26,064 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:51:26,322 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 00:51:26,322 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:51:26,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:51:26,800 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 00:51:26,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 00:51:27.741 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.757 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.771 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.785 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.800 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.817 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.867 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.873 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.887 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.896 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.906 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.918 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.927 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.933 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.940 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:27.945 UTC [14856] WARNING: there is no transaction in progress
2026-08-11 00:51:28,532 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 00:51:28,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 00:51:28,768 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 00:51:28,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:51:29,019 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 00:51:29,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:51:29,286 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 00:51:29,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:51:29,514 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:51:29,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xt4k.c.gcp-upstream.internal';"
2026-08-11 00:51:30,014 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 00:51:30,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 00:51:30,271 [I] DB_PATCHES have already been applied
I20260811 00:51:30.277247 27022 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task7ONN3e/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 00:51:30.277311 27022 mini_ranger.cc:193] Using host: 127.26.99.148
I20260811 00:51:30.281119 27022 mini_ranger.cc:227] Ranger admin URL: http://127.26.99.148:36819
Aug 11, 2026 12:51:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:51:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:51:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:51:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:51:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:51:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:51:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 00:51:31.603163 27022 mini_ranger.cc:160] Time spent starting Ranger: real 8.706s user 0.004s sys 0.007s
Aug 11, 2026 12:51:51 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:51:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 12:51:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:51:51 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:51:52 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 00:51:52.777524 27022 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangerkms_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/rangerkms_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.99.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.99.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 00:51:52 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409512, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 00:51:52.856554 27022 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 00:51:52.866209 27022 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 00:51:53.645718 27022 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 00:51:53.645788 27022 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms
I20260811 00:51:53.645807 27022 mini_ranger_kms.cc:227] Using postgres at 127.26.99.148:58823
2026-08-11 00:51:54,251 [I] DB FLAVOR :POSTGRES
2026-08-11 00:51:54,252 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:51:54,252 [I] Checking connection
2026-08-11 00:51:54,252 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 00:51:54,514 [I] connection success
2026-08-11 00:51:54,515 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 00:51:54,515 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 00:51:54,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 00:51:54,759 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 00:51:54,759 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:51:54,759 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 00:51:54,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:58823/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 00:51:55,050 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 00:51:55.519827 27022 mini_ranger_kms.cc:310] Created kms service
I20260811 00:51:55.716820 27022 mini_ranger_kms.cc:326] Created kudu user
I20260811 00:51:55.761397 27022 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 00:51:55 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409512, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:51:56.162814 27022 mini_ranger_kms.cc:384] Added ranger policy
I20260811 00:51:56.162931 27022 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms:/tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 00:51:56.162952 27022 mini_ranger_kms.cc:240] Using host: 127.26.99.148
I20260811 00:51:56.167644 27022 mini_ranger_kms.cc:276] Ranger KMS PID: 15175
I20260811 00:51:56.167744 27022 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.99.148:41309
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:51:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 00:51:58 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409518, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:51:58.820281 27022 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.964s user 0.010s sys 0.275s
I20260811 00:51:58.820399 27022 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 00:51:58.820479 27022 mini_ranger_kms.cc:401] 127.26.99.148:41309/kms/v1/keys
Aug 11 00:51:59 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409518, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
Aug 11 00:51:59 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409518, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
Aug 11 00:52:01 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:52:01.713255 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40291
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:40291
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:41309/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:01.799759 15276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:01.799975 15276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:01.800006 15276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:01.801220 15276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:01.801265 15276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:01.801285 15276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:01.801299 15276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:01.801316 15276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:01.802994 15276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.99.148:41309/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:40291
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:01.803246 15276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:01.803455 15276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:01.808596 15290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:01.808671 15276 server_base.cc:1034] running on GCE node
W20260811 00:52:01.808615 15282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:01.808626 15283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:01.809077 15276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:01.809391 15276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:01.810535 15276 hybrid_clock.cc:648] HybridClock initialized: now 1786409521810517 us; error 37 us; skew 500 ppm
Aug 11 00:52:01 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:01.812983 15276 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:01.813387 15276 webserver.cc:460] Webserver started at http://127.26.99.190:34881/ using document root <none> and password file <none>
I20260811 00:52:01.813566 15276 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:01.813601 15276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:01.813699 15276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:01 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:01.873193 15276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "4c63d12ce5fc49bbb73d48856e807c26"
format_stamp: "Formatted at 2026-08-11 00:52:01 on dist-test-slave-xt4k"
server_key: "312a106d99b7a47ef207cf7dd19b86e9"
server_key_iv: "10230ded1916ec3d2eea1236d0103ab8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:01.873891 15276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "4c63d12ce5fc49bbb73d48856e807c26"
format_stamp: "Formatted at 2026-08-11 00:52:01 on dist-test-slave-xt4k"
server_key: "312a106d99b7a47ef207cf7dd19b86e9"
server_key_iv: "10230ded1916ec3d2eea1236d0103ab8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:01.876121 15276 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 00:52:01.892747 15306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:01.892982 15276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 00:52:01.893106 15276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "4c63d12ce5fc49bbb73d48856e807c26"
format_stamp: "Formatted at 2026-08-11 00:52:01 on dist-test-slave-xt4k"
server_key: "312a106d99b7a47ef207cf7dd19b86e9"
server_key_iv: "10230ded1916ec3d2eea1236d0103ab8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:01.893210 15276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:01.923162 15276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:01.925061 15276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:01.925210 15276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:01.930327 15276 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:40291
I20260811 00:52:01.930377 15397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:40291 every 8 connection(s)
I20260811 00:52:01.930734 15276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:01.931538 15398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:01.934689 15398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: Bootstrap starting.
I20260811 00:52:01.935509 15398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:01.935870 15398 log.cc:824] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:01.936687 15398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: No bootstrap required, opened a new log
I20260811 00:52:01.939587 15398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } }
I20260811 00:52:01.939765 15398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:01.939805 15398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c63d12ce5fc49bbb73d48856e807c26, State: Initialized, Role: FOLLOWER
I20260811 00:52:01.939939 15398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } }
I20260811 00:52:01.940011 15398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:01.940038 15398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:01.940109 15398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:01.940155 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 15276
I20260811 00:52:01.940246 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:52:01.940469 27022 external_mini_cluster.cc:1428] Setting key 1b003a47b39d8e54d82de557fbb1acc3
I20260811 00:52:01.940821 15398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } }
I20260811 00:52:01.940956 15398 leader_election.cc:302] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c63d12ce5fc49bbb73d48856e807c26; no voters:
I20260811 00:52:01.941120 15398 leader_election.cc:288] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:52:01.941238 15408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:01.941430 15408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [term 1 LEADER]: Becoming Leader. State: Replica: 4c63d12ce5fc49bbb73d48856e807c26, State: Running, Role: LEADER
I20260811 00:52:01.941440 15398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:01.941586 15408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } }
I20260811 00:52:01.941906 15408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c63d12ce5fc49bbb73d48856e807c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } } }
I20260811 00:52:01.941982 15408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:01.942113 15408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c63d12ce5fc49bbb73d48856e807c26. Latest consensus state: current_term: 1 leader_uuid: "4c63d12ce5fc49bbb73d48856e807c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c63d12ce5fc49bbb73d48856e807c26" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40291 } } }
I20260811 00:52:01.942169 15408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:01.943091 15415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:01.943491 15398 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 00:52:01.943599 15415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:52:01 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:01.948403 15415 catalog_manager.cc:1347] Generated new cluster ID: e25f79ad49e34967927444747314dfb9
I20260811 00:52:01.948462 15415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:52:01.951764 15406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:01.940924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56744 (local address 127.26.99.190:40291)
0811 00:52:01.941132 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:01.941144 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:01.941176 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:52:01.941360 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:01.941369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:01.941429 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:01.941547 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:01.942426 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:01.943828 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:01.944876 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:01.945463 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:01.945572 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:01.948419 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:01.948431 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:01.948431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:01.948444 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:01.950204 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:01.950604 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:01.950608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:01.950608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:01.950711 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:01.950883 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:01.950883 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:01.950884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:01.951179 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:01.951330 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:01.951395 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 00:52:01.951524 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260811 00:52:01.963783 15415 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:52:01.964628 15415 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:01.975415 15415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: Generated new TSK 0
I20260811 00:52:01.975677 15415 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:52:02.676896 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:41309/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:02.800554 15470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:02.800807 15470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:02.800843 15470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:02.802484 15470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:02.802577 15470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:02.802628 15470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:02.804749 15470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.99.148:41309/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:02.804986 15470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:02.805238 15470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:02.810446 15483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:02.810555 15477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:02.810446 15478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:02.811224 15470 server_base.cc:1034] running on GCE node
I20260811 00:52:02.811417 15470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:02.811635 15470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:02.812770 15470 hybrid_clock.cc:648] HybridClock initialized: now 1786409522812758 us; error 30 us; skew 500 ppm
Aug 11 00:52:02 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409522, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:02.815248 15470 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:02.815650 15470 webserver.cc:460] Webserver started at http://127.26.99.129:40777/ using document root <none> and password file <none>
I20260811 00:52:02.815863 15470 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:02.815915 15470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:02.816077 15470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:02 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409522, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:02.836400 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "0f1270a69cde4accb46bd686ebc004bb"
format_stamp: "Formatted at 2026-08-11 00:52:02 on dist-test-slave-xt4k"
server_key: "ae3c98d40e164c62c62b2c9ec0d80051"
server_key_iv: "7999061bec08953e3338e3a3933c3767"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:02.837359 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "0f1270a69cde4accb46bd686ebc004bb"
format_stamp: "Formatted at 2026-08-11 00:52:02 on dist-test-slave-xt4k"
server_key: "ae3c98d40e164c62c62b2c9ec0d80051"
server_key_iv: "7999061bec08953e3338e3a3933c3767"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:02.839700 15470 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:02.856503 15497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:02.856706 15470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 00:52:02.856812 15470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "0f1270a69cde4accb46bd686ebc004bb"
format_stamp: "Formatted at 2026-08-11 00:52:02 on dist-test-slave-xt4k"
server_key: "ae3c98d40e164c62c62b2c9ec0d80051"
server_key_iv: "7999061bec08953e3338e3a3933c3767"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:02.856925 15470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:02.881395 15470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:02.883877 15470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:02.884095 15470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:02.884379 15470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:02.884828 15470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:02.884887 15470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:02.884917 15470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:02.884941 15470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:02.893236 15470 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:46269
I20260811 00:52:02.893297 15718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:46269 every 8 connection(s)
I20260811 00:52:02.893746 15470 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:52:02.894317 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 15470
I20260811 00:52:02.894426 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:52:02.894629 27022 external_mini_cluster.cc:1428] Setting key 8416b2fe243c6648ec0106b4eaf22a7b
Aug 11 00:52:02 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409522, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:02.904847 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:02.894543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40291 (local address 127.26.99.129:34747)
0811 00:52:02.894882 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:02.894929 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:02.895562 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:02.895989 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:02.895994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:02.896246 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:02.896554 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:02.896560 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:02.897483 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:02.897484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:02.898679 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:02.898682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:02.899036 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:02.899037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:02.899174 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:02.899672 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:02.899681 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:02.901036 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:02.903015 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:02.903023 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:02.903026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:02.903389 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:02.903631 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:02.903632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:02.903632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:02.903767 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:02.904084 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:02.904092 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:02.904267 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 00:52:02.904406 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 00:52:02.904587 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
I20260811 00:52:02.905398 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:02.894580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:34747 (local address 127.26.99.190:40291)
0811 00:52:02.895747 (+ 1167us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:02.895749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:02.895756 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:02.895779 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:02.895780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:02.895792 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:02.895861 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:02.896669 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:02.897373 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:02.898754 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:02.898961 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:02.899018 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:02.901125 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:02.901127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:02.901128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:02.901137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:02.902918 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:02.903480 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:02.903481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:02.903481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:02.903549 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:02.903846 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:02.903847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:02.903847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:02.903992 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:02.904055 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:02.905222 (+ 1167us) server_negotiation.cc:299] Negotiation successful
0811 00:52:02.905307 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1133,"thread_start_us":91,"threads_started":1}
I20260811 00:52:02.906152 15720 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40291
I20260811 00:52:02.906253 15720 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:02.906435 15720 heartbeater.cc:511] Master 127.26.99.190:40291 requested a full tablet report, sending...
I20260811 00:52:02.907012 15342 ts_manager.cc:194] Registered new tserver with Master: 0f1270a69cde4accb46bd686ebc004bb (127.26.99.129:46269)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
I20260811 00:52:02.907948 15342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:34747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:52:02.926930 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:41309/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 00:52:03.049537 15733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:03.049795 15733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:03.049831 15733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:03.051553 15733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:03.051615 15733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:03.051656 15733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:03.053895 15733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.99.148:41309/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:03.054271 15733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:03.054557 15733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:03.061074 15747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:03.061988 15743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:03.062443 15744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:03.062738 15733 server_base.cc:1034] running on GCE node
I20260811 00:52:03.063066 15733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:03.063359 15733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:03.064517 15733 hybrid_clock.cc:648] HybridClock initialized: now 1786409523064491 us; error 37 us; skew 500 ppm
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:03.067775 15733 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:03.068282 15733 webserver.cc:460] Webserver started at http://127.26.99.130:33899/ using document root <none> and password file <none>
I20260811 00:52:03.068569 15733 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:03.068619 15733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:03.068746 15733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:03.082499 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "e1273562e1cb486a88c16d42ef7c0a5a"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "650da3c8cef60b3ddca233e5b9fb07bb"
server_key_iv: "e677f4223e1b41fb4a22b69c230ce430"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.082974 15733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "e1273562e1cb486a88c16d42ef7c0a5a"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "650da3c8cef60b3ddca233e5b9fb07bb"
server_key_iv: "e677f4223e1b41fb4a22b69c230ce430"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.085743 15733 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260811 00:52:03.103858 15759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.109086 15733 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260811 00:52:03.109328 15733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "e1273562e1cb486a88c16d42ef7c0a5a"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "650da3c8cef60b3ddca233e5b9fb07bb"
server_key_iv: "e677f4223e1b41fb4a22b69c230ce430"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.109529 15733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:03.123989 15733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:03.126319 15733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:03.126509 15733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:03.126770 15733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:03.127183 15733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:03.127275 15733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.127354 15733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:03.127410 15733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.135134 15733 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:38169
I20260811 00:52:03.135623 15733 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:52:03.136349 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 15733
I20260811 00:52:03.136471 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:52:03.136705 27022 external_mini_cluster.cc:1428] Setting key 4f2789e2e4dc2117f68819cf93d12d91
I20260811 00:52:03.137930 15977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:38169 every 8 connection(s)
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:03.153137 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.138841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:44107 (local address 127.26.99.190:40291)
0811 00:52:03.138887 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.138889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.139330 (+ 441us) server_negotiation.cc:407] Connection header received
0811 00:52:03.140181 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.140182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.140198 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.140227 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:03.141075 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.141844 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.143418 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.143744 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.143791 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.149696 (+ 5905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:03.149697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:03.149698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:03.149706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:03.151410 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.151892 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.151894 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.151894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.151961 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.152263 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.152264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.152265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.152470 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:03.152519 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.152920 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.153026 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:52:03.153678 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.138527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40291 (local address 127.26.99.130:44107)
0811 00:52:03.139198 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.139244 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.140046 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.140434 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.140439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.140682 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:03.140961 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.140967 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.141965 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.141966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.143312 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.143315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.143884 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.143885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.144037 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.147871 (+ 3834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:03.147883 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:03.149575 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:03.151512 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:03.151519 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:03.151521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:03.151809 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:03.152039 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:03.152040 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:03.152040 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:03.152182 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:03.152568 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:03.152575 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:03.152747 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.153240 (+ 493us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.153409 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":107,"threads_started":1}
I20260811 00:52:03.154342 15980 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40291
I20260811 00:52:03.154441 15980 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:03.154634 15980 heartbeater.cc:511] Master 127.26.99.190:40291 requested a full tablet report, sending...
I20260811 00:52:03.155086 15342 ts_manager.cc:194] Registered new tserver with Master: e1273562e1cb486a88c16d42ef7c0a5a (127.26.99.130:38169)
I20260811 00:52:03.155448 15342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:44107
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:52:03.176911 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:41309/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:32969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:03.302206 15987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:03.302573 15987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:03.302660 15987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:03.304404 15987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:03.304503 15987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:03.304596 15987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:03.306767 15987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:32969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.99.148:41309/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:40291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:03.307216 15987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:03.307525 15987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:03.314704 16000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:03.314782 16002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:03.315919 15987 server_base.cc:1034] running on GCE node
W20260811 00:52:03.316705 15999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:03.317008 15987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:03.317267 15987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:03.318425 15987 hybrid_clock.cc:648] HybridClock initialized: now 1786409523318402 us; error 35 us; skew 500 ppm
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:03.322126 15987 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:03.322690 15987 webserver.cc:460] Webserver started at http://127.26.99.131:35627/ using document root <none> and password file <none>
I20260811 00:52:03.322973 15987 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:03.323032 15987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:03.323165 15987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:03.337623 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "efd9974c7ed1474b9e1d4fbd2502380d"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "922e27cf36f2fb93c3cf5101ef01cd2d"
server_key_iv: "3e18f46dc302a259cd5084b663d2daaa"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.338089 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "efd9974c7ed1474b9e1d4fbd2502380d"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "922e27cf36f2fb93c3cf5101ef01cd2d"
server_key_iv: "3e18f46dc302a259cd5084b663d2daaa"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.339708 15987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:52:03.355037 16013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.355276 15987 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:03.355367 15987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "efd9974c7ed1474b9e1d4fbd2502380d"
format_stamp: "Formatted at 2026-08-11 00:52:03 on dist-test-slave-xt4k"
server_key: "922e27cf36f2fb93c3cf5101ef01cd2d"
server_key_iv: "3e18f46dc302a259cd5084b663d2daaa"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:03.355455 15987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:03.379443 15987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:03.381394 15987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:03.381531 15987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:03.381745 15987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:03.382114 15987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:03.382153 15987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.382184 15987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:03.382222 15987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:03.389667 15987 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:41545
I20260811 00:52:03.389777 16227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:41545 every 8 connection(s)
I20260811 00:52:03.390074 15987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:52:03.391471 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 15987
I20260811 00:52:03.391564 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:52:03.391768 27022 external_mini_cluster.cc:1428] Setting key b8040de51cd8d1b9e9e57b2bc52be707
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:03.399075 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.390811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:34793 (local address 127.26.99.190:40291)
0811 00:52:03.390863 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.390865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.391118 (+ 253us) server_negotiation.cc:407] Connection header received
0811 00:52:03.391785 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.391786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.391800 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.391831 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:03.392668 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.393216 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.394173 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.394379 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.394434 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.396294 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:03.396295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:03.396296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:03.396303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:03.397645 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.398091 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.398093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.398093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.398159 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.398436 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.398437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.398437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.398556 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:03.398614 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.398895 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.398981 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:52:03.399456 16233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.390786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:40291 (local address 127.26.99.131:34793)
0811 00:52:03.391011 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.391041 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.391657 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.392022 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.392027 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.392268 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:03.392584 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.392602 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.393298 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.393299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.394093 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.394096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.394446 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.394447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.394582 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.395026 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:03.395036 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:03.396212 (+ 1176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:03.397771 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:03.397780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:03.397782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:03.398015 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:03.398259 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:03.398261 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:03.398261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:03.398360 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:03.398611 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:03.398625 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:03.398774 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.398863 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.399119 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":78,"threads_started":1}
I20260811 00:52:03.399869 16228 heartbeater.cc:347] Connected to a master server at 127.26.99.190:40291
I20260811 00:52:03.399964 16228 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:03.400144 16228 heartbeater.cc:511] Master 127.26.99.190:40291 requested a full tablet report, sending...
I20260811 00:52:03.400540 15342 ts_manager.cc:194] Registered new tserver with Master: efd9974c7ed1474b9e1d4fbd2502380d (127.26.99.131:41545)
I20260811 00:52:03.400904 15342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:34793
I20260811 00:52:03.403229 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:52:03.417636 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.404576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56758 (local address 127.26.99.190:40291)
0811 00:52:03.404614 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.404616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.404752 (+ 136us) server_negotiation.cc:407] Connection header received
0811 00:52:03.404808 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.404808 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.404818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.404861 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:03.405385 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.405919 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.406717 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.406922 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.406975 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.408059 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:03.408061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:03.408061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:03.408068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:03.409304 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.409604 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.409605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.409606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.409670 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:03.409873 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:03.409874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:03.409874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:03.409992 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:03.410065 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.417419 (+ 7354us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.417518 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:52:03.419965 15342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:52:03.422279 15342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:52:03.432353 16255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.425651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:41545 (local address 127.0.0.1:40096)
0811 00:52:03.426858 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.426866 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.426906 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.427201 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.427205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.427208 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.427281 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.427284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.428907 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.428908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.430273 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.430277 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.432019 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.432020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.432111 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.432125 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.432193 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.432247 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1191,"thread_start_us":83,"threads_started":1}
I20260811 00:52:03.432811 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.426086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40096 (local address 127.26.99.131:41545)
0811 00:52:03.426581 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.426586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.426959 (+ 373us) server_negotiation.cc:407] Connection header received
0811 00:52:03.427005 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.427008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.427025 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.427094 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.427365 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.428810 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.430824 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.431790 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.431869 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.431950 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.432679 (+ 729us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.432723 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":85,"threads_started":1}
I20260811 00:52:03.433769 16106 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 (DEFAULT_TABLE table=test-table [id=0157ffdb0c894317aa50f5f47edba3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:03.434172 16106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1b1aea625e4855918e2964c73d17a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:03.438385 16263 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Bootstrap starting.
I20260811 00:52:03.439633 16263 tablet_bootstrap.cc:654] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:03.440131 16263 log.cc:824] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:03.441012 16263 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: No bootstrap required, opened a new log
I20260811 00:52:03.441082 16263 ts_tablet_manager.cc:1397] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:52:03.441841 16252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.425818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:38169 (local address 127.0.0.1:52192)
0811 00:52:03.430686 (+ 4868us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.430696 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.430744 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.432654 (+ 1910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.432655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.432658 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.432699 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.432700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.433892 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.433893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.434921 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.434924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.441574 (+ 6650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.441576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.441649 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.441655 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.441708 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.441759 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4560,"thread_start_us":57,"threads_started":1}
I20260811 00:52:03.443161 16263 raft_consensus.cc:348] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.443332 16263 raft_consensus.cc:374] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:03.443367 16263 raft_consensus.cc:729] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd9974c7ed1474b9e1d4fbd2502380d, State: Initialized, Role: FOLLOWER
I20260811 00:52:03.443478 16263 consensus_queue.cc:260] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.443775 16263 ts_tablet_manager.cc:1428] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:52:03.444556 16228 heartbeater.cc:503] Master 127.26.99.190:40291 was elected leader, sending a full tablet report...
I20260811 00:52:03.444568 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.425936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.26.99.130:38169)
0811 00:52:03.427298 (+ 1362us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.427303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.432387 (+ 5084us) server_negotiation.cc:407] Connection header received
0811 00:52:03.432454 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.432456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.432474 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.432552 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.432772 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.433798 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.440420 (+ 6622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.441234 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.441313 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.441394 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.444431 (+ 3037us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.444482 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1321,"thread_start_us":99,"threads_started":1}
I20260811 00:52:03.445340 15850 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 (DEFAULT_TABLE table=test-table [id=0157ffdb0c894317aa50f5f47edba3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:03.445755 15850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1b1aea625e4855918e2964c73d17a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:03.449009 16270 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Bootstrap starting.
I20260811 00:52:03.450126 16270 tablet_bootstrap.cc:654] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:03.450608 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.425390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46269 (local address 127.0.0.1:43904)
0811 00:52:03.426648 (+ 1258us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.426690 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.426755 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.427599 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.427600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.427602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.427746 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.427747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.443212 (+ 15465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.443213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.444286 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.444290 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.450322 (+ 6032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.450324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.450400 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.450406 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.450469 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.450517 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1229,"thread_start_us":87,"threads_started":1}
I20260811 00:52:03.450632 16270 log.cc:824] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:03.451184 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.425480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.26.99.129:46269)
0811 00:52:03.427381 (+ 1901us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.427385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.427394 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:03.427428 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.427430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.427446 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.427517 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.427829 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.443092 (+ 15263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.449237 (+ 6145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.450027 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.450114 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.450260 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.451084 (+ 824us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.451129 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1864,"thread_start_us":53,"threads_started":1}
I20260811 00:52:03.452556 15588 tablet_service.cc:1467] Processing CreateTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 (DEFAULT_TABLE table=test-table [id=0157ffdb0c894317aa50f5f47edba3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:03.452945 15588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a1b1aea625e4855918e2964c73d17a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:03.457216 16274 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: Bootstrap starting.
I20260811 00:52:03.458035 16274 tablet_bootstrap.cc:654] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:03.458423 16274 log.cc:824] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:03.459254 16274 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: No bootstrap required, opened a new log
I20260811 00:52:03.459317 16274 ts_tablet_manager.cc:1397] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:03.461979 16270 tablet_bootstrap.cc:492] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: No bootstrap required, opened a new log
I20260811 00:52:03.462049 16270 ts_tablet_manager.cc:1397] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260811 00:52:03.462275 16274 raft_consensus.cc:348] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.462455 16274 raft_consensus.cc:374] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:03.462489 16274 raft_consensus.cc:729] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f1270a69cde4accb46bd686ebc004bb, State: Initialized, Role: FOLLOWER
I20260811 00:52:03.463306 16274 consensus_queue.cc:260] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.463680 16274 ts_tablet_manager.cc:1428] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 00:52:03.463861 15720 heartbeater.cc:503] Master 127.26.99.190:40291 was elected leader, sending a full tablet report...
I20260811 00:52:03.464145 16270 raft_consensus.cc:348] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.464308 16270 raft_consensus.cc:374] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:03.464367 16270 raft_consensus.cc:729] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1273562e1cb486a88c16d42ef7c0a5a, State: Initialized, Role: FOLLOWER
I20260811 00:52:03.464476 16270 consensus_queue.cc:260] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.464751 16270 ts_tablet_manager.cc:1428] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:52:03.464986 15980 heartbeater.cc:503] Master 127.26.99.190:40291 was elected leader, sending a full tablet report...
I20260811 00:52:03.566704 16276 raft_consensus.cc:482] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:03.566861 16276 raft_consensus.cc:504] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.567663 16276 leader_election.cc:288] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd9974c7ed1474b9e1d4fbd2502380d (127.26.99.131:41545), e1273562e1cb486a88c16d42ef7c0a5a (127.26.99.130:38169)
Aug 11 00:52:03 dist-test-slave-xt4k krb5kdc[14482](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:03.598404 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.568387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:45301 (local address 127.26.99.131:41545)
0811 00:52:03.568429 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.568431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.578173 (+ 9742us) server_negotiation.cc:407] Connection header received
0811 00:52:03.578291 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.578292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.578302 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.578332 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.579243 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.580122 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.596948 (+ 16826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.597612 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.597692 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.597702 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.598274 (+ 572us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.598327 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:52:03.598414 16282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.567871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:41545 (local address 127.26.99.129:45301)
0811 00:52:03.578071 (+ 10200us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.578088 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.578213 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.578401 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.578402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.578404 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.578523 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.578525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.580276 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.580277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.586348 (+ 6071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.586355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.598104 (+ 11749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.598106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.598189 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.598194 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.598260 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.598313 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10168,"thread_start_us":106,"threads_started":1}
I20260811 00:52:03.599134 16143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "0f1270a69cde4accb46bd686ebc004bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" is_pre_election: true
I20260811 00:52:03.599593 16143 raft_consensus.cc:2454] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1270a69cde4accb46bd686ebc004bb in term 0.
I20260811 00:52:03.600137 15500 leader_election.cc:302] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1270a69cde4accb46bd686ebc004bb, efd9974c7ed1474b9e1d4fbd2502380d; no voters:
I20260811 00:52:03.600306 16276 raft_consensus.cc:2781] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:52:03.600381 16276 raft_consensus.cc:482] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:52:03.600405 16276 raft_consensus.cc:3037] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:03.601406 16276 raft_consensus.cc:504] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.601549 16276 leader_election.cc:288] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [CANDIDATE]: Term 1 election: Requested vote from peers efd9974c7ed1474b9e1d4fbd2502380d (127.26.99.131:41545), e1273562e1cb486a88c16d42ef7c0a5a (127.26.99.130:38169)
I20260811 00:52:03.602144 16143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "0f1270a69cde4accb46bd686ebc004bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd9974c7ed1474b9e1d4fbd2502380d"
I20260811 00:52:03.602263 16143 raft_consensus.cc:3037] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:03.603271 16143 raft_consensus.cc:2454] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1270a69cde4accb46bd686ebc004bb in term 1.
I20260811 00:52:03.603518 16277 raft_consensus.cc:482] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:03.603621 16277 raft_consensus.cc:504] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.604009 16277 leader_election.cc:288] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f1270a69cde4accb46bd686ebc004bb (127.26.99.129:46269), efd9974c7ed1474b9e1d4fbd2502380d (127.26.99.131:41545)
I20260811 00:52:03.605026 15500 leader_election.cc:302] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1270a69cde4accb46bd686ebc004bb, efd9974c7ed1474b9e1d4fbd2502380d; no voters:
I20260811 00:52:03.605218 16276 raft_consensus.cc:2781] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:03.605376 16276 raft_consensus.cc:686] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 1 LEADER]: Becoming Leader. State: Replica: 0f1270a69cde4accb46bd686ebc004bb, State: Running, Role: LEADER
I20260811 00:52:03.605484 16276 consensus_queue.cc:237] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } }
I20260811 00:52:03.606473 15342 catalog_manager.cc:5495] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f1270a69cde4accb46bd686ebc004bb (127.26.99.129). New cstate: current_term: 1 leader_uuid: "0f1270a69cde4accb46bd686ebc004bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1270a69cde4accb46bd686ebc004bb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 } health_report { overall_health: UNKNOWN } } }
I20260811 00:52:03.610284 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.604257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46269 (local address 127.26.99.130:46627)
0811 00:52:03.604576 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.604587 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.604628 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.605168 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.605169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.605171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.605242 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.605244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.608152 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.608154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.609340 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.609343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.610021 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.610022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.610113 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.610117 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.610164 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.610213 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299}
I20260811 00:52:03.610890 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.604978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:46627 (local address 127.26.99.129:46269)
0811 00:52:03.605021 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.605023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.605030 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:03.605051 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.605052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.605062 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.605117 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.605315 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.608065 (+ 2750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.609437 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.609909 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.609977 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.609985 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.610791 (+ 806us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.610833 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:52:03.611122 15627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f1270a69cde4accb46bd686ebc004bb" is_pre_election: true
I20260811 00:52:03.611712 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.568314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:39615 (local address 127.26.99.130:38169)
0811 00:52:03.568387 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.568389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.586628 (+ 18239us) server_negotiation.cc:407] Connection header received
0811 00:52:03.586738 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.586740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.586753 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.586783 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.586996 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.587738 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.608936 (+ 21198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.609461 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.609501 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.609511 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.611605 (+ 2094us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.611651 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 00:52:03.612062 16278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.568074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:38169 (local address 127.26.99.129:39615)
0811 00:52:03.586559 (+ 18485us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.586572 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.586662 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.586848 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.586849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.586851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.586928 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.586930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.587881 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.587882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.595884 (+ 8002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.595890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.610679 (+ 14789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.610680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.610759 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.610762 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.611917 (+ 1155us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.611967 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18457,"thread_start_us":81,"threads_started":1}
I20260811 00:52:03.613838 15888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "0f1270a69cde4accb46bd686ebc004bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" is_pre_election: true
I20260811 00:52:03.613960 15888 raft_consensus.cc:2454] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1270a69cde4accb46bd686ebc004bb in term 0.
I20260811 00:52:03.614095 15887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "0f1270a69cde4accb46bd686ebc004bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1273562e1cb486a88c16d42ef7c0a5a"
I20260811 00:52:03.614164 15887 raft_consensus.cc:3037] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:03.615082 15887 raft_consensus.cc:2454] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1270a69cde4accb46bd686ebc004bb in term 1.
I20260811 00:52:03.615283 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.604740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:40971 (local address 127.26.99.131:41545)
0811 00:52:03.605189 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.605191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.610671 (+ 5480us) server_negotiation.cc:407] Connection header received
0811 00:52:03.610697 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.610698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.610708 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.610752 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:03.611236 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.611867 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.612989 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.613464 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.613532 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.613541 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.615175 (+ 1634us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.615221 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426}
I20260811 00:52:03.615365 15982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.604397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:41545 (local address 127.26.99.130:40971)
0811 00:52:03.610359 (+ 5962us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.610370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:03.610410 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:03.611116 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:03.611117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:03.611120 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:03.611157 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.611158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.611944 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.611945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.612895 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:03.612898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.613572 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.613573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:03.613632 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.613635 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:52:03.613678 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:52:03.613714 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5951,"thread_start_us":93,"threads_started":1}
I20260811 00:52:03.615653 16143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a1b1aea625e4855918e2964c73d17a6" candidate_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" is_pre_election: true
I20260811 00:52:03.615765 16143 raft_consensus.cc:2379] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1273562e1cb486a88c16d42ef7c0a5a in current term 1: Already voted for candidate 0f1270a69cde4accb46bd686ebc004bb in this term.
I20260811 00:52:03.615998 15767 leader_election.cc:302] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1273562e1cb486a88c16d42ef7c0a5a; no voters: 0f1270a69cde4accb46bd686ebc004bb, efd9974c7ed1474b9e1d4fbd2502380d
I20260811 00:52:03.616182 16277 raft_consensus.cc:2726] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 00:52:03.619871 16254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.617270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43906 (local address 127.26.99.129:46269)
0811 00:52:03.617304 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:03.617306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:03.617313 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:03.617343 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:03.617344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:03.617362 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:03.617429 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:52:03.617529 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.618130 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.618831 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:03.619085 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:03.619150 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:03.619308 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:52:03.619437 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:52:03.619519 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:03.619770 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 00:52:03.619790 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:52:03.623499 15887 raft_consensus.cc:1261] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 1 FOLLOWER]: Refusing update from remote peer 0f1270a69cde4accb46bd686ebc004bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:03.623795 16143 raft_consensus.cc:1261] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 1 FOLLOWER]: Refusing update from remote peer 0f1270a69cde4accb46bd686ebc004bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:03.624289 16276 consensus_queue.cc:1035] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1273562e1cb486a88c16d42ef7c0a5a" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 38169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:03.624470 16276 consensus_queue.cc:1035] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd9974c7ed1474b9e1d4fbd2502380d" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:03.629977 16294 mvcc.cc:205] Tried to move back new op lower bound from 7317133408759259136 to 7317133408688693248. Current Snapshot: MvccSnapshot[applied={T|T < 7317133408759259136}]
I20260811 00:52:03.631786 16296 mvcc.cc:205] Tried to move back new op lower bound from 7317133408759259136 to 7317133408688693248. Current Snapshot: MvccSnapshot[applied={T|T < 7317133408759259136}]
I20260811 00:52:03.634346 16301 mvcc.cc:205] Tried to move back new op lower bound from 7317133408759259136 to 7317133408688693248. Current Snapshot: MvccSnapshot[applied={T|T < 7317133408759259136}]
I20260811 00:52:03.636865 15342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:03.636953 15342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:03.637735 15342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c63d12ce5fc49bbb73d48856e807c26: Sending DeleteTablet for 3 replicas of tablet 3a1b1aea625e4855918e2964c73d17a6
I20260811 00:52:03.638244 15588 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:03 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:43904
I20260811 00:52:03.638279 15850 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:03 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:52192
I20260811 00:52:03.638495 16106 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a1b1aea625e4855918e2964c73d17a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:03 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:40096
I20260811 00:52:03.639127 16317 tablet_replica.cc:330] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: stopping tablet replica
I20260811 00:52:03.639258 16314 tablet_replica.cc:330] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb: stopping tablet replica
I20260811 00:52:03.639904 16314 raft_consensus.cc:2229] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:52:03.640129 16317 raft_consensus.cc:2229] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:03.640309 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 15470
I20260811 00:52:03.640664 16314 raft_consensus.cc:2258] T 3a1b1aea625e4855918e2964c73d17a6 P 0f1270a69cde4accb46bd686ebc004bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:03.641168 16317 raft_consensus.cc:2258] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:03.645978 16315 tablet_replica.cc:330] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: stopping tablet replica
I20260811 00:52:03.646183 16315 raft_consensus.cc:2229] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:03.646335 16315 raft_consensus.cc:2258] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:03.653337 16315 ts_tablet_manager.cc:1905] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:03.659229 16317 ts_tablet_manager.cc:1905] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:03.660719 16317 ts_tablet_manager.cc:1918] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:03.660867 16317 log.cc:1196] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/3a1b1aea625e4855918e2964c73d17a6
I20260811 00:52:03.661007 16315 ts_tablet_manager.cc:1918] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:03.661608 16317 ts_tablet_manager.cc:1939] T 3a1b1aea625e4855918e2964c73d17a6 P efd9974c7ed1474b9e1d4fbd2502380d: Deleting consensus metadata
I20260811 00:52:03.677495 15310 catalog_manager.cc:4841] TS efd9974c7ed1474b9e1d4fbd2502380d (127.26.99.131:41545): tablet 3a1b1aea625e4855918e2964c73d17a6 (table test-table [id=0157ffdb0c894317aa50f5f47edba3a7]) successfully deleted
I20260811 00:52:03.679391 16315 log.cc:1196] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/3a1b1aea625e4855918e2964c73d17a6
I20260811 00:52:03.680855 16315 ts_tablet_manager.cc:1939] T 3a1b1aea625e4855918e2964c73d17a6 P e1273562e1cb486a88c16d42ef7c0a5a: Deleting consensus metadata
I20260811 00:52:03.681414 15310 catalog_manager.cc:4841] TS e1273562e1cb486a88c16d42ef7c0a5a (127.26.99.130:38169): tablet 3a1b1aea625e4855918e2964c73d17a6 (table test-table [id=0157ffdb0c894317aa50f5f47edba3a7]) successfully deleted
W20260811 00:52:03.698176 15309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:46269 (error 108)
I20260811 00:52:03.699198 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.699081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46269 (local address 127.0.0.1:43916)
0811 00:52:03.699131 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.699161 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:46269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 00:52:03.699425 15309 catalog_manager.cc:4584] TS 0f1270a69cde4accb46bd686ebc004bb (127.26.99.129:46269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3a1b1aea625e4855918e2964c73d17a6: Network error: Client connection negotiation failed: client connection to 127.26.99.129:46269: connect: Connection refused (error 111)
I20260811 00:52:03.699679 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 15733
I20260811 00:52:03.752202 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.752067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46269 (local address 127.0.0.1:43924)
0811 00:52:03.752125 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.752155 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:46269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 00:52:03.752679 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:03.752575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:46269 (local address 127.0.0.1:43932)
0811 00:52:03.752621 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:03.752647 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:46269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:52:03.755028 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 15987
I20260811 00:52:03.796175 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 15276
I20260811 00:52:03.828881 27022 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 00:52:04.173184 27022 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 00:52:04.173305 27022 mini_ranger.cc:66] Stopping Ranger...
I20260811 00:52:04.527535 27022 mini_ranger.cc:68] Stopped Ranger
2026-08-11 00:52:04.527 UTC [14538] LOG: received smart shutdown request
2026-08-11 00:52:04.531 UTC [14538] LOG: background worker "logical replication launcher" (PID 14554) exited with exit code 1
2026-08-11 00:52:04.531 UTC [14544] LOG: shutting down
2026-08-11 00:52:04.679 UTC [14538] LOG: database system is shut down
2026-08-11T00:52:04Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46777 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:52:04 dist-test-slave-xt4k krb5kdc[16335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:52:04 dist-test-slave-xt4k krb5kdc[16335](info): set up 2 sockets
Aug 11 00:52:04 dist-test-slave-xt4k krb5kdc[16335](info): commencing operation
krb5kdc: starting...
W20260811 00:52:05.970544 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:52:06 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409526, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:52:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:52:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangeradmin_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangeradmin_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangerlookup_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangerlookup_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
I20260811 00:52:06.134414 27022 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task7ONN3e/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/postgres -l logfile start
2026-08-11 00:52:08.399 UTC [16394] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 00:52:08.399 UTC [16394] LOG: listening on IPv4 address "127.26.99.148", port 43857
2026-08-11 00:52:08.403 UTC [16394] LOG: listening on Unix socket "/tmp/.s.PGSQL.43857"
2026-08-11 00:52:08.431 UTC [16400] LOG: database system was shut down at 2026-08-11 00:52:07 UTC
2026-08-11 00:52:08.435 UTC [16394] LOG: database system is ready to accept connections
I20260811 00:52:09.533114 27022 mini_postgres.cc:96] Postgres bound to 43857
2026-08-11 00:52:09.539 UTC [16411] FATAL: database "slave" does not exist
127.26.99.148:43857 - accepting connections
I20260811 00:52:09.540383 27022 mini_ranger.cc:161] Starting Ranger...
I20260811 00:52:09.554379 27022 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 00:52:09.973953 27022 mini_ranger.cc:87] Created ranger Postgres database
I20260811 00:52:09.974027 27022 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin
2026-08-11 00:52:10,243 [I] DB FLAVOR :POSTGRES
2026-08-11 00:52:10,244 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:52:10,244 [I] Checking connection..
2026-08-11 00:52:10,244 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 00:52:10,507 [I] Checking connection passed.
2026-08-11 00:52:10,507 [I] --------- Verifying version history table ---------
2026-08-11 00:52:10,508 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:52:10,755 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:52:10,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:52:11,011 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 00:52:11,011 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 00:52:11,011 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 00:52:11.263 UTC [16538] WARNING: there is no transaction in progress
2026-08-11 00:52:11,272 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 00:52:11,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 00:52:11,517 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 00:52:11,517 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:52:11,517 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 00:52:11,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 00:52:12,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xt4k.c.gcp-upstream.internal','N') ;"
2026-08-11 00:52:12,240 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:52:12,491 [I] Table x_portal_user does not exist in database ranger
2026-08-11 00:52:12,492 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:52:12,751 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 00:52:12,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:52:13,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:52:13,241 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 00:52:13,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 00:52:14.159 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.174 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.189 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.204 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.219 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.238 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.288 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.294 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.307 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.317 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.327 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.340 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.349 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.355 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.361 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:14.367 UTC [16731] WARNING: there is no transaction in progress
2026-08-11 00:52:15,014 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 00:52:15,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 00:52:15,259 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 00:52:15,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 00:52:15,523 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 00:52:15,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 00:52:15,764 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 00:52:15,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 00:52:16,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 00:52:16,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xt4k.c.gcp-upstream.internal';"
2026-08-11 00:52:16,506 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 00:52:16,506 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 00:52:16,747 [I] DB_PATCHES have already been applied
I20260811 00:52:16.752633 27022 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task7ONN3e/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 00:52:16.752703 27022 mini_ranger.cc:193] Using host: 127.26.99.148
I20260811 00:52:16.756449 27022 mini_ranger.cc:227] Ranger admin URL: http://127.26.99.148:60999
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 12:52:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 00:52:18.009948 27022 mini_ranger.cc:160] Time spent starting Ranger: real 8.470s user 0.001s sys 0.008s
Aug 11, 2026 12:52:37 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 12:52:37 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 12:52:37 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 12:52:37 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 12:52:38 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 00:52:38.846261 27022 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.99.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.99.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangerkms_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.99.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/rangerkms_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.99.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.99.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.99.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/HTTP_127.26.99.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 00:52:38 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409558, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 00:52:38.938004 27022 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 00:52:38.948858 27022 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 00:52:39.710242 27022 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 00:52:39.710327 27022 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms
I20260811 00:52:39.710343 27022 mini_ranger_kms.cc:227] Using postgres at 127.26.99.148:43857
2026-08-11 00:52:39,871 [I] DB FLAVOR :POSTGRES
2026-08-11 00:52:39,872 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 00:52:39,872 [I] Checking connection
2026-08-11 00:52:39,872 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 00:52:40,114 [I] connection success
2026-08-11 00:52:40,114 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 00:52:40,114 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 00:52:40,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 00:52:40,356 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 00:52:40,356 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 00:52:40,356 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 00:52:40,356 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.99.148:43857/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 00:52:40,627 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 00:52:41.073652 27022 mini_ranger_kms.cc:310] Created kms service
I20260811 00:52:41.259874 27022 mini_ranger_kms.cc:326] Created kudu user
I20260811 00:52:41.303018 27022 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 00:52:41 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409558, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:41.718269 27022 mini_ranger_kms.cc:384] Added ranger policy
I20260811 00:52:41.718402 27022 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms:/tmp/dist-test-task7ONN3e/build/release/bin/postgresql.jar:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task7ONN3e/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 00:52:41.718423 27022 mini_ranger_kms.cc:240] Using host: 127.26.99.148
I20260811 00:52:41.722633 27022 mini_ranger_kms.cc:276] Ranger KMS PID: 17084
I20260811 00:52:41.722718 27022 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.99.148:50021
Aug 11, 2026 12:52:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 12:52:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 12:52:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 12:52:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 12:52:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 12:52:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 00:52:43 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409563, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:44.446377 27022 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.508s user 0.008s sys 0.138s
I20260811 00:52:44.446473 27022 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 00:52:44.446519 27022 mini_ranger_kms.cc:401] 127.26.99.148:50021/kms/v1/keys
Aug 11 00:52:44 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409563, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
Aug 11 00:52:44 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409563, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.99.148@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
Aug 11 00:52:47 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:52:47.104589 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37795
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37795
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:47.186913 17197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:47.187115 17197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:47.187135 17197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:47.188279 17197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:47.188320 17197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:47.188355 17197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:47.188372 17197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:47.188393 17197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:47.189987 17197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.99.148:50021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37795
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:47.190217 17197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:47.190423 17197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:47.196122 17210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:47.196131 17214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:47.196190 17209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:47.196933 17197 server_base.cc:1034] running on GCE node
I20260811 00:52:47.197140 17197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:47.197408 17197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:47.198549 17197 hybrid_clock.cc:648] HybridClock initialized: now 1786409567198532 us; error 33 us; skew 500 ppm
Aug 11 00:52:47 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409567, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:47.205480 17197 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:47.205931 17197 webserver.cc:460] Webserver started at http://127.26.99.190:42683/ using document root <none> and password file <none>
I20260811 00:52:47.206137 17197 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:47.206176 17197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:47.206290 17197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:47 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409567, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:47.260612 17197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "0fbb65cef13d4cb7941df3850fac1116"
format_stamp: "Formatted at 2026-08-11 00:52:47 on dist-test-slave-xt4k"
server_key: "6af944ff06e3194ae3e516b07c8200b5"
server_key_iv: "298cdb828d1474a8d7a73b731c19b6d8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:47.261070 17197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "0fbb65cef13d4cb7941df3850fac1116"
format_stamp: "Formatted at 2026-08-11 00:52:47 on dist-test-slave-xt4k"
server_key: "6af944ff06e3194ae3e516b07c8200b5"
server_key_iv: "298cdb828d1474a8d7a73b731c19b6d8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:47.262989 17197 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:47.275283 17227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:47.275475 17197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:47.275580 17197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "0fbb65cef13d4cb7941df3850fac1116"
format_stamp: "Formatted at 2026-08-11 00:52:47 on dist-test-slave-xt4k"
server_key: "6af944ff06e3194ae3e516b07c8200b5"
server_key_iv: "298cdb828d1474a8d7a73b731c19b6d8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:47.275682 17197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:47.284402 17197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:47.286273 17197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:47.286408 17197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:47.290416 17197 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37795
I20260811 00:52:47.290513 17325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37795 every 8 connection(s)
I20260811 00:52:47.290901 17197 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:47.291687 17326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:47.294701 17326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Bootstrap starting.
I20260811 00:52:47.295373 17326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:47.295676 17326 log.cc:824] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:47.296461 17326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: No bootstrap required, opened a new log
I20260811 00:52:47.299294 17326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:47.299479 17326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:47.299510 17326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbb65cef13d4cb7941df3850fac1116, State: Initialized, Role: FOLLOWER
I20260811 00:52:47.299649 17326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:47.299721 17326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:47.299752 17326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:47.299794 17326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:47.300472 17326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:47.300582 17326 leader_election.cc:302] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fbb65cef13d4cb7941df3850fac1116; no voters:
I20260811 00:52:47.300698 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 17197
I20260811 00:52:47.300792 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:52:47.300877 17326 leader_election.cc:288] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:52:47.301146 27022 external_mini_cluster.cc:1428] Setting key 40d36ed52cc93360c9cf3c9a56a82a9f
I20260811 00:52:47.301137 17334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:47.301227 17326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:47.301283 17334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 LEADER]: Becoming Leader. State: Replica: 0fbb65cef13d4cb7941df3850fac1116, State: Running, Role: LEADER
I20260811 00:52:47.301752 17334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:47.302176 17335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fbb65cef13d4cb7941df3850fac1116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } } }
I20260811 00:52:47.302253 17335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:47.302420 17335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fbb65cef13d4cb7941df3850fac1116. Latest consensus state: current_term: 1 leader_uuid: "0fbb65cef13d4cb7941df3850fac1116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } } }
I20260811 00:52:47.302471 17335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:47.302681 17326 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 00:52:47.303580 17356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:47.304078 17356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:47.308655 17356 catalog_manager.cc:1347] Generated new cluster ID: a98094bd29ee4ddca11761bfba668e2a
I20260811 00:52:47.308755 17356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:52:47 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:47.328032 17342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:47.301636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56352 (local address 127.26.99.190:37795)
0811 00:52:47.301882 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:47.301892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:47.302179 (+ 287us) server_negotiation.cc:407] Connection header received
0811 00:52:47.302428 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:47.302436 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:47.302497 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:47.302616 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:47.303502 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:47.304895 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:47.306748 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:47.308267 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:47.311113 (+ 2846us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:47.311216 (+ 103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:47.311220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:47.311220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:47.311229 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:47.325960 (+ 14731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:47.326386 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:47.326389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:47.326389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:47.326502 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:47.326688 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:47.326688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:47.326689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:47.326983 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:47.327588 (+ 605us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:47.327665 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 00:52:47.327803 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":68,"threads_started":1}
I20260811 00:52:47.332219 17356 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:52:47.333050 17356 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:47.342842 17356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Generated new TSK 0
I20260811 00:52:47.343109 17356 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:52:48.051458 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:48.142253 17404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:48.142486 17404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:48.142518 17404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:48.143793 17404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:48.143837 17404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:48.143870 17404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:48.145437 17404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:48.145758 17404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:48.146015 17404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:48.150946 17414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.150936 17418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.151199 17413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:48.151767 17404 server_base.cc:1034] running on GCE node
I20260811 00:52:48.151964 17404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:48.152213 17404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:48.153380 17404 hybrid_clock.cc:648] HybridClock initialized: now 1786409568153368 us; error 27 us; skew 500 ppm
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:48.155925 17404 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:48.156381 17404 webserver.cc:460] Webserver started at http://127.26.99.129:38409/ using document root <none> and password file <none>
I20260811 00:52:48.156586 17404 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:48.156647 17404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:48.156769 17404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:48.173983 17404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "9d7cfc0c60154ff68d10f456b33b9e85"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "087908b1e58d6e6bde304cdecbcf0a57"
server_key_iv: "121cd7a1711ae833c4b3532deb447df2"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.174441 17404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "9d7cfc0c60154ff68d10f456b33b9e85"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "087908b1e58d6e6bde304cdecbcf0a57"
server_key_iv: "121cd7a1711ae833c4b3532deb447df2"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.176712 17404 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:48.196803 17431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.197058 17404 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 00:52:48.197160 17404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "9d7cfc0c60154ff68d10f456b33b9e85"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "087908b1e58d6e6bde304cdecbcf0a57"
server_key_iv: "121cd7a1711ae833c4b3532deb447df2"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.197243 17404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:48.234230 17404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:48.241081 17404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:48.242436 17404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:48.242724 17404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:48.243109 17404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:48.243156 17404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.243187 17404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:48.243211 17404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.250525 17404 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:44017
I20260811 00:52:48.250955 17404 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:52:48.252107 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 17404
I20260811 00:52:48.252206 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:52:48.252477 27022 external_mini_cluster.cc:1428] Setting key 2253229bcfa74441f41a66f4e1e5207d
I20260811 00:52:48.273288 17639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:44017 every 8 connection(s)
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
I20260811 00:52:48.281656 17651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.251744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:39991 (local address 127.26.99.190:37795)
0811 00:52:48.255168 (+ 3424us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:48.255170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:48.258995 (+ 3825us) server_negotiation.cc:407] Connection header received
0811 00:52:48.259029 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:48.259031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:48.259045 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:48.259142 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:48.261046 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.261874 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.263757 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.264070 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.264143 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.274351 (+ 10208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:48.274353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:48.274354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:48.274364 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:48.276256 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.276838 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.276839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.276840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.276911 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.277197 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.277198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.277198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.277352 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:48.277409 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:48.281429 (+ 4020us) server_negotiation.cc:299] Negotiation successful
0811 00:52:48.281548 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3391,"thread_start_us":115,"threads_started":1}
I20260811 00:52:48.282277 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.251717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.129:39991)
0811 00:52:48.256438 (+ 4721us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:48.256509 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:48.257256 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:48.260166 (+ 2910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:48.260172 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:48.260513 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:48.260906 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.260915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.262511 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.262513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.263658 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.263662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.264233 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.264234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.264413 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.272496 (+ 8083us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:48.272510 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:48.274234 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:48.276422 (+ 2188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.276431 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.276434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.276746 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.276980 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.276981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.276981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.277121 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.277436 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:48.277456 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:48.277630 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 00:52:48.277735 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 00:52:48.277916 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4664,"thread_start_us":109,"threads_started":1}
I20260811 00:52:48.283109 17642 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:48.283226 17642 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:48.283459 17642 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:48.284029 17257 ts_manager.cc:194] Registered new tserver with Master: 9d7cfc0c60154ff68d10f456b33b9e85 (127.26.99.129:44017)
I20260811 00:52:48.285041 17257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:39991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:52:48.309834 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:48.426527 17657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:48.426802 17657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:48.426839 17657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 00:52:48.428495 17657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:48.428552 17657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:48.428592 17657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:48.430745 17657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:48.430981 17657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:48.431226 17657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:48.438650 17679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.440784 17678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.441270 17683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:48.445475 17657 server_base.cc:1034] running on GCE node
I20260811 00:52:48.445777 17657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:48.446063 17657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:48.449342 17657 hybrid_clock.cc:648] HybridClock initialized: now 1786409568449312 us; error 37 us; skew 500 ppm
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:48.452708 17657 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:48.453256 17657 webserver.cc:460] Webserver started at http://127.26.99.130:39161/ using document root <none> and password file <none>
I20260811 00:52:48.453518 17657 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:48.453572 17657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:48.453696 17657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:48.473006 17657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "1d92a66d97af4947a8012f5280b16b55"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "c3fdb4b267174e59aa81044fd453d936"
server_key_iv: "381fbaa98b79320b5602bfa0095ed842"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.473486 17657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "1d92a66d97af4947a8012f5280b16b55"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "c3fdb4b267174e59aa81044fd453d936"
server_key_iv: "381fbaa98b79320b5602bfa0095ed842"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.477031 17657 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 00:52:48.496526 17693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.496722 17657 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 00:52:48.496825 17657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "1d92a66d97af4947a8012f5280b16b55"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "c3fdb4b267174e59aa81044fd453d936"
server_key_iv: "381fbaa98b79320b5602bfa0095ed842"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.496928 17657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:48.509078 17657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:48.511262 17657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:48.511389 17657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:48.511629 17657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:48.511962 17657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:48.511996 17657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.512024 17657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:48.512041 17657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.518834 17657 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:40253
I20260811 00:52:48.519258 17657 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:52:48.519728 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 17657
I20260811 00:52:48.519830 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:52:48.520046 27022 external_mini_cluster.cc:1428] Setting key e9d79e984d3d647380ab2e65fe79f31c
I20260811 00:52:48.524286 17898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:40253 every 8 connection(s)
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:48.543458 17651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.530037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:36917 (local address 127.26.99.190:37795)
0811 00:52:48.530089 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:48.530091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:48.530385 (+ 294us) server_negotiation.cc:407] Connection header received
0811 00:52:48.533568 (+ 3183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:48.533569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:48.533590 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:48.533639 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:48.534296 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.535131 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.537156 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.537452 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.537500 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.540046 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:48.540048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:48.540048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:48.540056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:48.541743 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.542243 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.542245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.542246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.542307 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.542634 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.542635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.542635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.542787 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:48.542834 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:48.543225 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 00:52:48.543326 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:52:48.544668 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.530015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.130:36917)
0811 00:52:48.530230 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:48.530289 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:48.533445 (+ 3156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:48.533734 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:48.533739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:48.533934 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:48.534202 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.534208 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.535246 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.535247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.537049 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.537053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.537614 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.537615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.537763 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.538362 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:48.538374 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:48.539938 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:48.541846 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.541853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.541856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.542148 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.542399 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.542400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.542400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.542550 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.542882 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:48.542889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:48.543061 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 00:52:48.544189 (+ 1128us) client_negotiation.cc:240] Negotiation successful
0811 00:52:48.544408 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
I20260811 00:52:48.545336 17899 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:48.545444 17899 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:48.545642 17899 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:48.546012 17257 ts_manager.cc:194] Registered new tserver with Master: 1d92a66d97af4947a8012f5280b16b55 (127.26.99.130:40253)
I20260811 00:52:48.546380 17257 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:36917
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:52:48.555509 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:48.673980 17908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:48.674280 17908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:48.674317 17908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:48.675601 17908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:48.675648 17908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:48.675683 17908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:48.677249 17908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:48.677484 17908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:48.677696 17908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:48.682809 17922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.682789 17919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.682803 17924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:48.683418 17908 server_base.cc:1034] running on GCE node
I20260811 00:52:48.683598 17908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:48.683826 17908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:48.684963 17908 hybrid_clock.cc:648] HybridClock initialized: now 1786409568684947 us; error 30 us; skew 500 ppm
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:48.687674 17908 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:48.688222 17908 webserver.cc:460] Webserver started at http://127.26.99.131:40949/ using document root <none> and password file <none>
I20260811 00:52:48.688508 17908 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:48.688573 17908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:48.688709 17908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:48.701908 17908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "9fd1787c029b4d72be01d44a87ae0f6a"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "8388539c988c65e35ab7e73856b7bd96"
server_key_iv: "c59f547829cbad59f714970060da6538"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.702533 17908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "9fd1787c029b4d72be01d44a87ae0f6a"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "8388539c988c65e35ab7e73856b7bd96"
server_key_iv: "c59f547829cbad59f714970060da6538"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.704881 17908 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:48.732502 17936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.732775 17908 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 00:52:48.732873 17908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "9fd1787c029b4d72be01d44a87ae0f6a"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "8388539c988c65e35ab7e73856b7bd96"
server_key_iv: "c59f547829cbad59f714970060da6538"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:48.732968 17908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:48.765264 17908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:48.767541 17908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:48.767732 17908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:48.768018 17908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:48.768436 17908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:48.768486 17908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.768553 17908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:48.768610 17908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:48.775106 17908 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:44705
I20260811 00:52:48.775461 17908 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:52:48.778067 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 17908
I20260811 00:52:48.778173 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:52:48.778389 27022 external_mini_cluster.cc:1428] Setting key a9a279b6b2a64fc9709dcd127c9d97bc
I20260811 00:52:48.780700 18140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:44705 every 8 connection(s)
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:48.788750 17651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.776193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:60553 (local address 127.26.99.190:37795)
0811 00:52:48.776249 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:48.776251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:48.780996 (+ 4745us) server_negotiation.cc:407] Connection header received
0811 00:52:48.781669 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:48.781670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:48.781683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:48.781747 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:48.782371 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.782941 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.783988 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.784200 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.784257 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.786212 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:48.786213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:48.786214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:48.786221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:48.787439 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.787793 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.787794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.787794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.787846 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:48.788064 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:48.788065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:48.788065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:48.788175 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:48.788231 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:48.788575 (+ 344us) server_negotiation.cc:299] Negotiation successful
0811 00:52:48.788657 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:52:48.788892 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:48.776165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.131:60553)
0811 00:52:48.780855 (+ 4690us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:48.780898 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:48.781549 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:48.781893 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:48.781898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:48.782084 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:48.782279 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.782284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.783038 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.783039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.783906 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:48.783909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:48.784283 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:48.784284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:48.784432 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:48.784904 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:48.784913 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:48.786127 (+ 1214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:48.787504 (+ 1377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.787512 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.787515 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.787727 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.787900 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:48.787901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:48.787901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:48.788009 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:48.788231 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:48.788238 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:48.788435 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 00:52:48.788537 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 00:52:48.788678 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4644,"thread_start_us":534,"threads_started":1}
I20260811 00:52:48.789364 18143 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:48.789454 18143 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:48.789636 18143 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:48.789980 17256 ts_manager.cc:194] Registered new tserver with Master: 9fd1787c029b4d72be01d44a87ae0f6a (127.26.99.131:44705)
I20260811 00:52:48.790357 17256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:60553
I20260811 00:52:48.803301 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:52:48.804064 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 17404
I20260811 00:52:48.825325 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 17657
I20260811 00:52:48.834488 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 17908
I20260811 00:52:48.844516 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 17197
I20260811 00:52:48.864549 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37795
--webserver_interface=127.26.99.190
--webserver_port=42683
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37795
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:48.945760 18148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:48.945951 18148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:48.945972 18148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:48.947074 18148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:48.947113 18148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:48.947127 18148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:48.947150 18148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:48.947173 18148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:48.948778 18148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37795
--ranger_config_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=42683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:48.948992 18148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:48.949198 18148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:48.953758 18159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.953768 18166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:48.953814 18164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:48.954133 18148 server_base.cc:1034] running on GCE node
I20260811 00:52:48.954358 18148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:48.954623 18148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:48.955775 18148 hybrid_clock.cc:648] HybridClock initialized: now 1786409568955760 us; error 32 us; skew 500 ppm
Aug 11 00:52:48 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:48.958195 18148 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:48.958595 18148 webserver.cc:460] Webserver started at http://127.26.99.190:42683/ using document root <none> and password file <none>
I20260811 00:52:48.958796 18148 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:48.958841 18148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409568, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:49.027505 18148 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:49.028210 18181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.028424 18148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:49.028510 18148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "0fbb65cef13d4cb7941df3850fac1116"
format_stamp: "Formatted at 2026-08-11 00:52:47 on dist-test-slave-xt4k"
server_key: "6af944ff06e3194ae3e516b07c8200b5"
server_key_iv: "298cdb828d1474a8d7a73b731c19b6d8"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:49.028887 18148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:49.044694 18148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:49.046527 18148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:49.046653 18148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:49.050799 18148 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37795
I20260811 00:52:49.050859 18271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37795 every 8 connection(s)
I20260811 00:52:49.051200 18148 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:49.052421 18272 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:52:49.053066 18272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Bootstrap starting.
I20260811 00:52:49.060951 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 18148
I20260811 00:52:49.060992 18272 log.cc:824] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:49.061265 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:44017
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:37795
--webserver_port=38409
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:49.063251 18272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:52:49.063511 18272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Bootstrap complete.
I20260811 00:52:49.066709 18272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:49.067047 18272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbb65cef13d4cb7941df3850fac1116, State: Initialized, Role: FOLLOWER
I20260811 00:52:49.067238 18272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:49.067317 18272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:49.067361 18272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:49.067410 18272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:52:49.068811 18272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:49.068930 18272 leader_election.cc:302] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fbb65cef13d4cb7941df3850fac1116; no voters:
I20260811 00:52:49.069103 18272 leader_election.cc:288] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:52:49.069157 18277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:52:49.069315 18277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [term 2 LEADER]: Becoming Leader. State: Replica: 0fbb65cef13d4cb7941df3850fac1116, State: Running, Role: LEADER
I20260811 00:52:49.069360 18272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:49.069439 18277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } }
I20260811 00:52:49.069736 18283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fbb65cef13d4cb7941df3850fac1116. Latest consensus state: current_term: 2 leader_uuid: "0fbb65cef13d4cb7941df3850fac1116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } } }
I20260811 00:52:49.069820 18283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:49.069727 18278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0fbb65cef13d4cb7941df3850fac1116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb65cef13d4cb7941df3850fac1116" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37795 } } }
I20260811 00:52:49.069967 18278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:49.070091 18288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:49.070601 18288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:49.070752 18288 catalog_manager.cc:1259] Loaded cluster ID: a98094bd29ee4ddca11761bfba668e2a
I20260811 00:52:49.070788 18288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:52:49.071062 18272 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 00:52:49.073968 18288 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:49.074502 18288 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Loaded TSK: 0
I20260811 00:52:49.074783 18288 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:52:49.173270 18276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:49.173462 18276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:49.173493 18276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:49.174628 18276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:49.174666 18276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:49.174701 18276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:49.176170 18276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:44017
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=38409
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:49.176410 18276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:49.176635 18276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:49.183207 18352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:49.184405 18276 server_base.cc:1034] running on GCE node
W20260811 00:52:49.184484 18342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:49.184492 18343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:49.187050 18276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:49.187342 18276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:49.188490 18276 hybrid_clock.cc:648] HybridClock initialized: now 1786409569188466 us; error 37 us; skew 500 ppm
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:49.191053 18276 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:49.191524 18276 webserver.cc:460] Webserver started at http://127.26.99.129:38409/ using document root <none> and password file <none>
I20260811 00:52:49.191771 18276 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:49.191856 18276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:49.207319 18276 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:49.208168 18366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.208372 18276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:49.208467 18276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "9d7cfc0c60154ff68d10f456b33b9e85"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "087908b1e58d6e6bde304cdecbcf0a57"
server_key_iv: "121cd7a1711ae833c4b3532deb447df2"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:49.208837 18276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:49.229214 18276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:49.231141 18276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:49.231300 18276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:49.231556 18276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:49.231935 18276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:49.231973 18276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.232003 18276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:49.232025 18276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.238993 18276 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:44017
I20260811 00:52:49.239076 18567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:44017 every 8 connection(s)
I20260811 00:52:49.239418 18276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:49.248555 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 18276
I20260811 00:52:49.248863 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:40253
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:37795
--webserver_port=39161
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:49.252012 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.240857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:34527 (local address 127.26.99.190:37795)
0811 00:52:49.241794 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:49.241803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:49.241843 (+ 40us) server_negotiation.cc:407] Connection header received
0811 00:52:49.242000 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:49.242006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:49.242060 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:49.242191 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:49.242980 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.243863 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.245370 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.245794 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.245891 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.248243 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:49.248247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:49.248247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:49.248257 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:49.250103 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.250508 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.250512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.250512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.250639 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.250952 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.250953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.250953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.251256 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:49.251339 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:49.251690 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 00:52:49.251818 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":873,"thread_start_us":88,"threads_started":1}
I20260811 00:52:49.252028 18571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.240660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.129:34527)
0811 00:52:49.240936 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:49.240978 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:49.241574 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:49.242276 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:49.242281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:49.242532 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:49.242828 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.242835 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.243970 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.243972 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.245268 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.245271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.245921 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.245923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.246063 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.246600 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:49.246609 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:49.248136 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:49.250183 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.250190 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.250193 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.250406 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.250716 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.250717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.250718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.250866 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.251335 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:49.251341 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:49.251501 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 00:52:49.251618 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 00:52:49.251780 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":89,"threads_started":1}
I20260811 00:52:49.252939 18568 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:49.253050 18568 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.253247 18568 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.254245 18568 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37795 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:52:49.254319 18568 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.254386 18568 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:49.254874 18568 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.254961 18568 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.255330 18568 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:52:49.357288 18575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:49.357494 18575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:49.357525 18575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:49.359185 18575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:49.359241 18575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:49.359277 18575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:49.361544 18575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:40253
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=39161
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:49.361809 18575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:49.362082 18575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:49.368614 18584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:49.368697 18585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:49.368911 18588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:49.369041 18575 server_base.cc:1034] running on GCE node
I20260811 00:52:49.369266 18575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:49.369549 18575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:49.370731 18575 hybrid_clock.cc:648] HybridClock initialized: now 1786409569370705 us; error 39 us; skew 500 ppm
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:49.374080 18575 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:49.374646 18575 webserver.cc:460] Webserver started at http://127.26.99.130:39161/ using document root <none> and password file <none>
I20260811 00:52:49.374912 18575 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:49.374996 18575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:49.394709 18575 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:49.397354 18602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.397588 18575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260811 00:52:49.397682 18575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "1d92a66d97af4947a8012f5280b16b55"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "c3fdb4b267174e59aa81044fd453d936"
server_key_iv: "381fbaa98b79320b5602bfa0095ed842"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:49.398159 18575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:49.411000 18575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:49.412909 18575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:49.413058 18575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:49.413282 18575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:49.413617 18575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:49.413654 18575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.413683 18575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:49.413708 18575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.420784 18575 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:40253
I20260811 00:52:49.421185 18575 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:52:49.421813 18794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:40253 every 8 connection(s)
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:49.428791 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 18575
I20260811 00:52:49.429059 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.99.148:50021/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:44705
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:37795
--webserver_port=40949
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:49.430274 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.422244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:41433 (local address 127.26.99.190:37795)
0811 00:52:49.422323 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:49.422325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:49.422337 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:52:49.422753 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:49.422755 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:49.422770 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:49.422819 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:49.423361 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.423911 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.424966 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.425208 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.425265 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.427315 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:49.427316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:49.427316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:49.427323 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:49.428620 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.429131 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.429133 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.429133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.429199 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.429549 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.429550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.429551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.429689 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:49.429756 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:49.430093 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 00:52:49.430185 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 00:52:49.430486 18804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.421927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.130:41433)
0811 00:52:49.422091 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:49.422131 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:49.422651 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:49.422888 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:49.422892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:49.423072 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:49.423266 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.423271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.424006 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.424007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.424874 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.424877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.425296 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.425297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.425407 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.425859 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:49.425867 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:49.427197 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:49.428705 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.428713 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.428715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.429027 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.429270 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.429271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.429272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.429420 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.429768 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:49.429775 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:49.429944 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 00:52:49.430082 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 00:52:49.430256 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260811 00:52:49.430996 18796 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:49.431118 18796 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.431301 18796 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.431999 18796 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37795 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:52:49.432077 18796 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.432137 18796 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:49.432540 18796 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.432633 18796 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.432984 18796 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:52:49.531400 18806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:49.531596 18806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:49.531618 18806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:49.533004 18806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:49.533051 18806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:49.533087 18806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:49.534986 18806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.99.148:50021/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:44705
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=40949
--tserver_master_addrs=127.26.99.190:37795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:49.535215 18806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:49.535445 18806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:49.540236 18814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:49.540212 18811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:49.540205 18812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:49.540628 18806 server_base.cc:1034] running on GCE node
I20260811 00:52:49.540824 18806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:49.541045 18806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:49.542191 18806 hybrid_clock.cc:648] HybridClock initialized: now 1786409569542179 us; error 25 us; skew 500 ppm
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:49.544708 18806 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:49.545203 18806 webserver.cc:460] Webserver started at http://127.26.99.131:40949/ using document root <none> and password file <none>
I20260811 00:52:49.545503 18806 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:49.545584 18806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:49.568809 18806 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.000s sys 0.000s
I20260811 00:52:49.569964 18828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.570181 18806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:52:49.570276 18806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "9fd1787c029b4d72be01d44a87ae0f6a"
format_stamp: "Formatted at 2026-08-11 00:52:48 on dist-test-slave-xt4k"
server_key: "8388539c988c65e35ab7e73856b7bd96"
server_key_iv: "c59f547829cbad59f714970060da6538"
server_key_version: "kuduclusterkey@0"
I20260811 00:52:49.570799 18806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:49.581022 18806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:49.582855 18806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:49.583002 18806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:49.583202 18806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:49.583536 18806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:49.583572 18806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.583603 18806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:49.583626 18806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:49.590333 18806 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:44705
I20260811 00:52:49.590400 19038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:44705 every 8 connection(s)
I20260811 00:52:49.590813 18806 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:52:49.596273 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 18806
Aug 11 00:52:49 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409569, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:49.599849 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.591745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:41929 (local address 127.26.99.190:37795)
0811 00:52:49.591802 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:49.591805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:49.592042 (+ 237us) server_negotiation.cc:407] Connection header received
0811 00:52:49.592592 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:49.592594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:49.592607 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:49.592658 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:49.593201 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.593708 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.594674 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.594882 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.594940 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.597118 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:49.597119 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:49.597119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:49.597126 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:49.598401 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.598856 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.598858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.598858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.598958 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.599223 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.599224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.599225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.599347 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:49.599379 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:49.599674 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 00:52:49.599760 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:52:49.599996 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.591721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37795 (local address 127.26.99.131:41929)
0811 00:52:49.591897 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:49.591947 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:49.592496 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:49.592725 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:49.592729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:49.592906 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:49.593111 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.593115 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.593789 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.593790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.594589 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:49.594591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.594978 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.594979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:49.595102 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.595609 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:49.595617 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:49.597021 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:49.598477 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.598485 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.598487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.598767 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.599032 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:49.599033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:49.599033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:49.599157 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:49.599415 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:49.599420 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:49.599549 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 00:52:49.599634 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:52:49.599780 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":87,"threads_started":1}
I20260811 00:52:49.600458 19041 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37795
I20260811 00:52:49.600543 19041 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.600687 19041 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.601397 19041 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37795 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 00:52:49.601466 19041 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.601532 19041 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:49.601902 19041 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:49.602028 19041 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
W20260811 00:52:49.602361 19041 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:52:49.609427 19051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:49.596765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56366 (local address 127.26.99.190:37795)
0811 00:52:49.597088 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:49.597090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:49.597096 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:52:49.597115 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:49.597116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:49.597127 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:49.597193 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:49.598480 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.599203 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.604766 (+ 5563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:49.605042 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:49.605103 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:49.606572 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:49.606573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:49.606573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:49.606580 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:49.608109 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.608554 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.608556 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.608556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.608626 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:49.608864 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:49.608865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:49.608865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:49.609012 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:49.609180 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:49.609267 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 00:52:49.609344 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":69,"threads_started":1}
Aug 11 00:52:50 dist-test-slave-xt4k krb5kdc[16335](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786409570, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:50.255524 18568 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:50.255697 18568 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:50.256120 18213 ts_manager.cc:194] Registered new tserver with Master: 9d7cfc0c60154ff68d10f456b33b9e85 (127.26.99.129:44017)
I20260811 00:52:50.257170 18213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:34527
I20260811 00:52:50.433166 18796 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:50.433336 18796 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:50.433662 18213 ts_manager.cc:194] Registered new tserver with Master: 1d92a66d97af4947a8012f5280b16b55 (127.26.99.130:40253)
I20260811 00:52:50.434206 18213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:41433
Aug 11 00:52:50 dist-test-slave-xt4k krb5kdc[16335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409570, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for HTTP/127.26.99.148@KRBTEST.COM
I20260811 00:52:50.602546 19041 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:50.602703 19041 heartbeater.cc:511] Master 127.26.99.190:37795 requested a full tablet report, sending...
I20260811 00:52:50.603047 18213 ts_manager.cc:194] Registered new tserver with Master: 9fd1787c029b4d72be01d44a87ae0f6a (127.26.99.131:44705)
I20260811 00:52:50.603566 18213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:41929
I20260811 00:52:50.606730 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:52:50.619872 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.607732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56372 (local address 127.26.99.190:37795)
0811 00:52:50.607844 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.607846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.612268 (+ 4422us) server_negotiation.cc:407] Connection header received
0811 00:52:50.612325 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.612326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.612371 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.612448 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:50.613139 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.613937 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.614972 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.615258 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.615333 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.616831 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:50.616833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:50.616833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:50.616842 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:50.618550 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:50.618930 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:50.618932 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:50.618932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:50.619001 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:50.619195 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:50.619196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:50.619196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:50.619332 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:50.619433 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.619551 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.619636 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":65,"threads_started":1}
I20260811 00:52:50.622109 18213 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:52:50.624392 18213 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:52:50.632890 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.627350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:40253 (local address 127.0.0.1:33348)
0811 00:52:50.628292 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.628302 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.628473 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.628723 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:50.628723 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:50.628725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:50.628778 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.628780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.630000 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.630001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.631401 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.631404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.632543 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.632545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.632651 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.632664 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 00:52:50.632728 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 00:52:50.632777 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":90,"thread_start_us":93,"threads_started":1}
I20260811 00:52:50.633008 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.627347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44017 (local address 127.0.0.1:49038)
0811 00:52:50.627641 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.627681 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.627742 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.628313 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:50.628316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:50.628318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:50.628410 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.628412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.630076 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.630077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.631358 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.631361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.632753 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.632754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.632847 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.632852 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:52:50.632892 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 00:52:50.632933 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":30,"thread_start_us":80,"threads_started":1}
I20260811 00:52:50.633514 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.627863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.26.99.130:40253)
0811 00:52:50.628431 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.628436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.628446 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:52:50.628552 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.628554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.628581 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.628647 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:50.628844 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.629906 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.631494 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.632377 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.632448 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.632509 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.633394 (+ 885us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.633439 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":56,"threads_started":1}
I20260811 00:52:50.633503 19095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.628010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49038 (local address 127.26.99.129:44017)
0811 00:52:50.628139 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.628144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.628154 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:52:50.628188 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.628190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.628206 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.628485 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:50.628578 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.629980 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.631468 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.632668 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.633056 (+ 388us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.633134 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.633374 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.633424 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":61,"threads_started":1}
I20260811 00:52:50.634364 18454 tablet_service.cc:1467] Processing CreateTablet for tablet 08e5a514fde7440185892386d828fc82 (DEFAULT_TABLE table=test-table [id=95d491ab29374ef98a40e5ef339597da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:50.634567 18654 tablet_service.cc:1467] Processing CreateTablet for tablet 08e5a514fde7440185892386d828fc82 (DEFAULT_TABLE table=test-table [id=95d491ab29374ef98a40e5ef339597da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:50.634811 18454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08e5a514fde7440185892386d828fc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:50.634914 18654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08e5a514fde7440185892386d828fc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:50.640679 19100 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: Bootstrap starting.
I20260811 00:52:50.640717 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.627579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:44705 (local address 127.0.0.1:44294)
0811 00:52:50.632396 (+ 4817us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.632406 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.632462 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.632741 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:50.632742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:50.632745 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:50.637042 (+ 4297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.637046 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.638242 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.638243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.639385 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.639388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.640464 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.640466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.640540 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.640545 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:52:50.640595 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 00:52:50.640639 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4799,"mutex_wait_us":4217,"thread_start_us":63,"threads_started":1}
I20260811 00:52:50.641003 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.628157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.26.99.131:44705)
0811 00:52:50.630272 (+ 2115us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.630276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.632521 (+ 2245us) server_negotiation.cc:407] Connection header received
0811 00:52:50.632561 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.632563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.632578 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.632647 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:50.637145 (+ 4498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.638150 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.639487 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.640266 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.640366 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.640427 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.640878 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.640926 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2083,"thread_start_us":53,"threads_started":1}
I20260811 00:52:50.641613 19100 tablet_bootstrap.cc:654] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:50.641777 18917 tablet_service.cc:1467] Processing CreateTablet for tablet 08e5a514fde7440185892386d828fc82 (DEFAULT_TABLE table=test-table [id=95d491ab29374ef98a40e5ef339597da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:50.641999 19100 log.cc:824] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:50.642132 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08e5a514fde7440185892386d828fc82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:50.642684 19099 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Bootstrap starting.
I20260811 00:52:50.643378 19099 tablet_bootstrap.cc:654] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:50.643662 19099 log.cc:824] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:50.644441 19099 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: No bootstrap required, opened a new log
I20260811 00:52:50.644502 19099 ts_tablet_manager.cc:1397] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:50.646991 19099 raft_consensus.cc:348] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.647169 19099 raft_consensus.cc:374] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:50.647202 19099 raft_consensus.cc:729] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d92a66d97af4947a8012f5280b16b55, State: Initialized, Role: FOLLOWER
I20260811 00:52:50.647318 19099 consensus_queue.cc:260] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.647576 19099 ts_tablet_manager.cc:1428] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:52:50.647722 18796 heartbeater.cc:503] Master 127.26.99.190:37795 was elected leader, sending a full tablet report...
I20260811 00:52:50.647904 19109 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Bootstrap starting.
I20260811 00:52:50.648540 19109 tablet_bootstrap.cc:654] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:50.648896 19109 log.cc:824] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:50.649775 19100 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: No bootstrap required, opened a new log
I20260811 00:52:50.649848 19100 ts_tablet_manager.cc:1397] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 00:52:50.650099 19109 tablet_bootstrap.cc:492] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: No bootstrap required, opened a new log
I20260811 00:52:50.650161 19109 ts_tablet_manager.cc:1397] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:50.652617 19109 raft_consensus.cc:348] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.652819 19109 raft_consensus.cc:374] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:50.652858 19109 raft_consensus.cc:729] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fd1787c029b4d72be01d44a87ae0f6a, State: Initialized, Role: FOLLOWER
I20260811 00:52:50.652994 19109 consensus_queue.cc:260] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.652788 19100 raft_consensus.cc:348] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.653234 19100 raft_consensus.cc:374] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:50.653297 19109 ts_tablet_manager.cc:1428] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:52:50.653317 19100 raft_consensus.cc:729] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7cfc0c60154ff68d10f456b33b9e85, State: Initialized, Role: FOLLOWER
I20260811 00:52:50.653455 19041 heartbeater.cc:503] Master 127.26.99.190:37795 was elected leader, sending a full tablet report...
I20260811 00:52:50.653548 19100 consensus_queue.cc:260] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.654109 18568 heartbeater.cc:503] Master 127.26.99.190:37795 was elected leader, sending a full tablet report...
I20260811 00:52:50.654213 19100 ts_tablet_manager.cc:1428] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 00:52:50.665748 19115 raft_consensus.cc:482] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:50.665881 19115 raft_consensus.cc:504] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.666267 19115 leader_election.cc:288] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d7cfc0c60154ff68d10f456b33b9e85 (127.26.99.129:44017), 9fd1787c029b4d72be01d44a87ae0f6a (127.26.99.131:44705)
I20260811 00:52:50.670364 19121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.666445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:44705 (local address 127.26.99.130:58433)
0811 00:52:50.667118 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.667128 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.667175 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.667323 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:50.667324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:50.667325 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:50.667387 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.667389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.668225 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.668226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.669352 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.669354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.670102 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.670103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.670173 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.670178 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:52:50.670219 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 00:52:50.670260 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":119,"threads_started":1}
I20260811 00:52:50.670526 19095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.666658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:49129 (local address 127.26.99.129:44017)
0811 00:52:50.666707 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.666709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.666802 (+ 93us) server_negotiation.cc:407] Connection header received
0811 00:52:50.666905 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.666906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.666916 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.666944 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:50.667191 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.667923 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.669468 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.670068 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.670117 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.670125 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.670396 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.670460 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:52:50.670809 19098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.666670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:58433 (local address 127.26.99.131:44705)
0811 00:52:50.667050 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.667052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.667218 (+ 166us) server_negotiation.cc:407] Connection header received
0811 00:52:50.667241 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.667242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.667250 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.667284 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:50.667444 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.668136 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.669450 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.669971 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.670044 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.670053 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.670700 (+ 647us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.670746 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344}
I20260811 00:52:50.670794 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.666437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44017 (local address 127.26.99.130:49129)
0811 00:52:50.666735 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.666747 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.666831 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.667023 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:50.667024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:50.667025 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:50.667112 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.667113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.668038 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.668039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.669306 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:50.669310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.670223 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.670224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:50.670307 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.670311 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:50.670667 (+ 356us) client_negotiation.cc:240] Negotiation successful
0811 00:52:50.670713 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260811 00:52:50.671273 18919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08e5a514fde7440185892386d828fc82" candidate_uuid: "1d92a66d97af4947a8012f5280b16b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" is_pre_election: true
I20260811 00:52:50.671450 18919 raft_consensus.cc:2454] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d92a66d97af4947a8012f5280b16b55 in term 0.
I20260811 00:52:50.671717 18603 leader_election.cc:302] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d92a66d97af4947a8012f5280b16b55, 9fd1787c029b4d72be01d44a87ae0f6a; no voters:
I20260811 00:52:50.671849 19115 raft_consensus.cc:2781] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:52:50.671885 19115 raft_consensus.cc:482] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:52:50.671903 19115 raft_consensus.cc:3037] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:50.671911 18485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08e5a514fde7440185892386d828fc82" candidate_uuid: "1d92a66d97af4947a8012f5280b16b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" is_pre_election: true
I20260811 00:52:50.672096 18485 raft_consensus.cc:2454] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d92a66d97af4947a8012f5280b16b55 in term 0.
W20260811 00:52:50.672456 18801 tablet.cc:2369] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:52:50.672859 19115 raft_consensus.cc:504] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.672986 19115 leader_election.cc:288] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [CANDIDATE]: Term 1 election: Requested vote from peers 9d7cfc0c60154ff68d10f456b33b9e85 (127.26.99.129:44017), 9fd1787c029b4d72be01d44a87ae0f6a (127.26.99.131:44705)
I20260811 00:52:50.673182 18485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08e5a514fde7440185892386d828fc82" candidate_uuid: "1d92a66d97af4947a8012f5280b16b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d7cfc0c60154ff68d10f456b33b9e85"
I20260811 00:52:50.673260 18485 raft_consensus.cc:3037] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:50.673329 18919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08e5a514fde7440185892386d828fc82" candidate_uuid: "1d92a66d97af4947a8012f5280b16b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fd1787c029b4d72be01d44a87ae0f6a"
I20260811 00:52:50.673404 18919 raft_consensus.cc:3037] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:50.674157 18485 raft_consensus.cc:2454] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d92a66d97af4947a8012f5280b16b55 in term 1.
I20260811 00:52:50.674190 18919 raft_consensus.cc:2454] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d92a66d97af4947a8012f5280b16b55 in term 1.
I20260811 00:52:50.674350 18608 leader_election.cc:302] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d92a66d97af4947a8012f5280b16b55, 9d7cfc0c60154ff68d10f456b33b9e85; no voters:
I20260811 00:52:50.674502 19115 raft_consensus.cc:2781] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:50.674679 19115 raft_consensus.cc:686] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [term 1 LEADER]: Becoming Leader. State: Replica: 1d92a66d97af4947a8012f5280b16b55, State: Running, Role: LEADER
I20260811 00:52:50.674789 19115 consensus_queue.cc:237] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } }
I20260811 00:52:50.675673 18213 catalog_manager.cc:5495] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d92a66d97af4947a8012f5280b16b55 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "1d92a66d97af4947a8012f5280b16b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d92a66d97af4947a8012f5280b16b55" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 } health_report { overall_health: UNKNOWN } } }
I20260811 00:52:50.681792 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.678728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33360 (local address 127.26.99.130:40253)
0811 00:52:50.678791 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:50.678793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:50.678802 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:50.678832 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:50.678833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:50.678852 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:50.678933 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:52:50.679083 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.679794 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.680898 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:50.681191 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:50.681264 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:50.681438 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:52:50.681567 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:52:50.681681 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:50.681700 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 00:52:50.681724 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:52:50.683986 18919 raft_consensus.cc:1261] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 1 FOLLOWER]: Refusing update from remote peer 1d92a66d97af4947a8012f5280b16b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:50.684394 18485 raft_consensus.cc:1261] T 08e5a514fde7440185892386d828fc82 P 9d7cfc0c60154ff68d10f456b33b9e85 [term 1 FOLLOWER]: Refusing update from remote peer 1d92a66d97af4947a8012f5280b16b55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:50.684397 19122 consensus_queue.cc:1035] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fd1787c029b4d72be01d44a87ae0f6a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 44705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:50.684650 19122 consensus_queue.cc:1035] T 08e5a514fde7440185892386d828fc82 P 1d92a66d97af4947a8012f5280b16b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d7cfc0c60154ff68d10f456b33b9e85" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:50.687655 19125 mvcc.cc:205] Tried to move back new op lower bound from 7317133601518956544 to 7317133601484550144. Current Snapshot: MvccSnapshot[applied={T|T < 7317133601518956544}]
I20260811 00:52:50.688408 19128 mvcc.cc:205] Tried to move back new op lower bound from 7317133601518956544 to 7317133601484550144. Current Snapshot: MvccSnapshot[applied={T|T < 7317133601518956544}]
I20260811 00:52:50.692679 18211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:50.692780 18211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:50.693702 18211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fbb65cef13d4cb7941df3850fac1116: Sending DeleteTablet for 3 replicas of tablet 08e5a514fde7440185892386d828fc82
I20260811 00:52:50.694003 19126 mvcc.cc:205] Tried to move back new op lower bound from 7317133601518956544 to 7317133601484550144. Current Snapshot: MvccSnapshot[applied={T|T < 7317133601518956544 or (T in {7317133601518956544})}]
I20260811 00:52:50.694054 18654 tablet_service.cc:1514] Processing DeleteTablet for tablet 08e5a514fde7440185892386d828fc82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:50 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:33348
I20260811 00:52:50.694622 18917 tablet_service.cc:1514] Processing DeleteTablet for tablet 08e5a514fde7440185892386d828fc82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:50 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44294
I20260811 00:52:50.694720 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 18276
W20260811 00:52:50.713083 18186 connection.cc:535] client connection to 127.26.99.129:44017 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 00:52:50.713213 18186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:52:50.713524 19145 tablet_replica.cc:330] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: stopping tablet replica
I20260811 00:52:50.713516 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 18575
I20260811 00:52:50.713666 19145 raft_consensus.cc:2229] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:50.713802 19145 raft_consensus.cc:2258] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:50.716377 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.714220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44017 (local address 127.0.0.1:49046)
0811 00:52:50.716258 (+ 2038us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.716313 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2006}
W20260811 00:52:50.716507 18186 catalog_manager.cc:4584] TS 9d7cfc0c60154ff68d10f456b33b9e85 (127.26.99.129:44017): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08e5a514fde7440185892386d828fc82: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44017: connect: Connection refused (error 111)
W20260811 00:52:50.726835 19089 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:52:50.726470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:40253 (local address 127.0.0.1:33374)
0811 00:52:50.726533 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.726544 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:50.726586 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:50.726785 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.130:40253: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 00:52:50.727059 19145 ts_tablet_manager.cc:1905] T 08e5a514fde7440185892386d828fc82 P 9fd1787c029b4d72be01d44a87ae0f6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:50.727289 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 18806
I20260811 00:52:50.751454 19089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:50.751329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:44705 (local address 127.0.0.1:44296)
0811 00:52:50.751378 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:50.751405 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.131:44705: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:52:50.751685 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 18148
I20260811 00:52:50.767903 27022 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 00:52:51.112895 27022 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 00:52:51.113006 27022 mini_ranger.cc:66] Stopping Ranger...
I20260811 00:52:51.457892 27022 mini_ranger.cc:68] Stopped Ranger
2026-08-11 00:52:51.458 UTC [16394] LOG: received smart shutdown request
2026-08-11 00:52:51.462 UTC [16394] LOG: background worker "logical replication launcher" (PID 16409) exited with exit code 1
2026-08-11 00:52:51.462 UTC [16401] LOG: shutting down
2026-08-11 00:52:51.605 UTC [16394] LOG: database system is shut down
2026-08-11T00:52:51Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46921 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:52:51 dist-test-slave-xt4k krb5kdc[19162](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:52:51 dist-test-slave-xt4k krb5kdc[19162](info): set up 2 sockets
Aug 11 00:52:51 dist-test-slave-xt4k krb5kdc[19162](info): commencing operation
krb5kdc: starting...
W20260811 00:52:52.892509 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:52:52 dist-test-slave-xt4k krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:52:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:52:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:52:53.017123 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33393
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:53.099615 19187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:53.099818 19187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:53.099848 19187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:53.101071 19187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:53.101114 19187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:53.101133 19187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:53.101150 19187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:53.101164 19187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:53.102700 19187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:33393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:53.102932 19187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:53.103152 19187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:53.107820 19199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.107853 19204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.107831 19201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:53.108105 19187 server_base.cc:1034] running on GCE node
I20260811 00:52:53.108377 19187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:53.108685 19187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:53.109923 19187 hybrid_clock.cc:648] HybridClock initialized: now 1786409573109903 us; error 33 us; skew 500 ppm
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:53.115973 19187 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:53.116458 19187 webserver.cc:460] Webserver started at http://127.26.99.190:39637/ using document root <none> and password file <none>
I20260811 00:52:53.116704 19187 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:53.116757 19187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:53.116878 19187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:53.117919 19187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "8be93054c3814cf09773ba97d8e92bbd"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "a6d32570ed9e5f1db4a93bb541f702cc"
server_key_iv: "0af59bb8d4076c0b6decc0401647c792"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.118263 19187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "8be93054c3814cf09773ba97d8e92bbd"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "a6d32570ed9e5f1db4a93bb541f702cc"
server_key_iv: "0af59bb8d4076c0b6decc0401647c792"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.119495 19187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:52:53.120204 19216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:53.120383 19187 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:53.120479 19187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "8be93054c3814cf09773ba97d8e92bbd"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "a6d32570ed9e5f1db4a93bb541f702cc"
server_key_iv: "0af59bb8d4076c0b6decc0401647c792"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.120553 19187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:53.167377 19187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:53.169432 19187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:53.169579 19187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:53.173662 19187 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:33393
I20260811 00:52:53.173712 19311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:33393 every 8 connection(s)
I20260811 00:52:53.174050 19187 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:53.174962 19312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:53.176489 19312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:53.183595 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 19187
I20260811 00:52:53.183710 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:52:53.183936 27022 external_mini_cluster.cc:1428] Setting key 8cf90f5ac7b475379e83119f6bdd28e6
I20260811 00:52:53.185981 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.177136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.26.99.190:33393)
0811 00:52:53.177301 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.177311 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.177387 (+ 76us) server_negotiation.cc:407] Connection header received
0811 00:52:53.177863 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.177864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.177881 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.177953 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.178443 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.179272 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.180133 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.180506 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.180588 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.182589 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.182596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.182596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.182602 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.184371 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.184742 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.184745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.184746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.184848 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.185057 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.185057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.185058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.185328 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.185402 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.185556 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.185757 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260811 00:52:53.185994 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.177109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33393 (local address 127.0.0.1:35052)
0811 00:52:53.177270 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.177308 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.177749 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.177978 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.177980 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.178216 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.178377 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.178381 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.179351 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.179352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.180064 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.180066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.180574 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.180575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.180638 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.181085 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.181093 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.182485 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.184466 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.184472 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.184474 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.184665 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.184909 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.184910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.184910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.184999 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.185390 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.185393 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.185444 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.185515 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.185679 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260811 00:52:53.186754 19312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:52:53.187124 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.186990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51924)
0811 00:52:53.187044 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.187099 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 00:52:53.187285 19222 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
I20260811 00:52:53.187703 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.187612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51934)
0811 00:52:53.187654 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.187684 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 00:52:53.187850 19312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41195: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.99.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
I20260811 00:52:53.208678 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:41195
--webserver_interface=127.26.99.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:53.237082 19312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } attempt: 1
I20260811 00:52:53.237630 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.237472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51950)
0811 00:52:53.237541 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.237592 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 00:52:53.238025 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.237935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51964)
0811 00:52:53.237973 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.238003 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 00:52:53.238133 19312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41195: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
W20260811 00:52:53.290510 19324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:53.290729 19324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:53.290751 19324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:53.292074 19324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:53.292133 19324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:53.292148 19324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:53.292160 19324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:53.292171 19324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:53.294049 19324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:41195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.99.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:53.294332 19324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:53.294554 19324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:53.299353 19334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.299451 19330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.299353 19331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:53.299563 19324 server_base.cc:1034] running on GCE node
I20260811 00:52:53.299862 19324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:53.300181 19324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:53.301354 19324 hybrid_clock.cc:648] HybridClock initialized: now 1786409573301356 us; error 49 us; skew 500 ppm
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:53.303860 19324 init.cc:377] Logged in from keytab as kudu/127.26.99.189@KRBTEST.COM (short username kudu)
I20260811 00:52:53.304288 19324 webserver.cc:460] Webserver started at http://127.26.99.189:33729/ using document root <none> and password file <none>
I20260811 00:52:53.304536 19324 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:53.304587 19324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:53.304713 19324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:53.305757 19324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data/instance:
uuid: "12be8c6528a54336a18dd77b7efed7eb"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "00b2e8e00306e1e18e1ad3e985cb69a1"
server_key_iv: "f451cda4f7ea6caad8c2f2f36a657fbd"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.306100 19324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal/instance:
uuid: "12be8c6528a54336a18dd77b7efed7eb"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "00b2e8e00306e1e18e1ad3e985cb69a1"
server_key_iv: "f451cda4f7ea6caad8c2f2f36a657fbd"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.306289 19312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } attempt: 2
I20260811 00:52:53.306668 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.306548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51974)
0811 00:52:53.306601 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.306634 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:52:53.307071 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.306930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51978)
0811 00:52:53.306971 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.306996 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 00:52:53.307190 19312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41195: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41195: connect: Connection refused (error 111)
I20260811 00:52:53.307778 19324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:52:53.308496 19346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:53.308646 19324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:53.308737 19324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "12be8c6528a54336a18dd77b7efed7eb"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "00b2e8e00306e1e18e1ad3e985cb69a1"
server_key_iv: "f451cda4f7ea6caad8c2f2f36a657fbd"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.308794 19324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:53.316855 19324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:53.318830 19324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:53.318943 19324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:53.322819 19324 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.189:41195
I20260811 00:52:53.322856 19444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.189:41195 every 8 connection(s)
I20260811 00:52:53.323197 19324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
I20260811 00:52:53.323422 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 19324
I20260811 00:52:53.323516 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-1/wal/instance
I20260811 00:52:53.323738 27022 external_mini_cluster.cc:1428] Setting key 2a98c2ca292ccbcba430f9c3afe1438b
I20260811 00:52:53.324250 19445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:53.326375 19445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.99.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.188@KRBTEST.COM" created.
I20260811 00:52:53.335932 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.327160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.26.99.190:33393)
0811 00:52:53.327214 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.327215 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.327452 (+ 237us) server_negotiation.cc:407] Connection header received
0811 00:52:53.327948 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.327949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.327965 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.328017 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.328661 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.329164 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.330616 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.330922 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.330992 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.333322 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.333323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.333324 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.333330 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.334612 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.335069 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.335070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.335070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.335118 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.335302 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.335303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.335303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.335413 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.335474 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.335789 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.335858 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:52:53.336191 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.327133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33393 (local address 127.0.0.1:35068)
0811 00:52:53.327315 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.327352 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.327843 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.328081 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.328084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.328359 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.328576 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.328581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.329250 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.329251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.330509 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.330512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.331013 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.331014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.331166 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.331652 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.331662 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.333234 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.334702 (+ 1468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.334709 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.334711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.335004 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.335163 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.335164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.335164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.335261 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.335469 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.335474 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.335650 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.335770 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.335940 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260811 00:52:53.336791 19445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:52:53.344772 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.337105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51982)
0811 00:52:53.337151 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.337163 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.337202 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.337464 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.337465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.337603 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.337655 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.337656 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.338825 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.338826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.339317 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.339319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.339958 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.339960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.340036 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.340448 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.340452 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.341778 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.343795 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.343796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.343796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.343972 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.344181 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.344181 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.344182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.344225 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.344532 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.344532 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.344568 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.344619 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.344702 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 00:52:53.344877 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.337150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51982 (local address 127.26.99.189:41195)
0811 00:52:53.337305 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.337310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.337329 (+ 19us) server_negotiation.cc:407] Connection header received
0811 00:52:53.337351 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.337353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.337367 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.337455 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.337720 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.338734 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.339400 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.339858 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.339936 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.341880 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.341888 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.341888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.341895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.343703 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.344049 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.344053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.344053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.344122 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.344269 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.344270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.344271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.344470 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.344556 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.344654 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.344765 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
I20260811 00:52:53.345382 19445 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:52:53.345692 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.345596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60100)
0811 00:52:53.345634 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.345677 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 00:52:53.345896 19352 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
I20260811 00:52:53.346268 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.346195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60114)
0811 00:52:53.346231 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.346254 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 00:52:53.346377 19445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:38663: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
I20260811 00:52:53.351143 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:38663
--webserver_interface=127.26.99.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:53.395601 19445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } attempt: 1
I20260811 00:52:53.396088 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.395966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60130)
0811 00:52:53.396022 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.396056 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:52:53.396409 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.396313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60144)
0811 00:52:53.396366 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.396390 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 00:52:53.396497 19445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:38663: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
I20260811 00:52:53.398356 19312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } attempt: 3
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:52:53.405345 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.398658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51984)
0811 00:52:53.398717 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.398727 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.398777 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.398893 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.398893 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.399063 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.399131 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.399133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.399785 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.399787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.400304 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.400306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.400823 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.400824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.400907 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.401324 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.401329 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.402784 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.404378 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.404379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.404380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.404563 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.404739 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.404740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.404740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.404799 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.405025 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.405026 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.405078 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.405137 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.405245 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:52:53.405344 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.398728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.26.99.189:41195)
0811 00:52:53.398788 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.398790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.398801 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:52:53.398830 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.398831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.398841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.398888 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.399200 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.399714 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.400395 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.400722 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.400805 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.402881 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.402882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.402882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.402890 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.404271 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.404626 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.404627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.404627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.404683 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.404847 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.404848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.404848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.404964 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.405026 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.405182 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.405251 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:52:53.406121 19312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:52:53.406534 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.406419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60156)
0811 00:52:53.406470 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.406506 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 00:52:53.406822 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.406743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60160)
0811 00:52:53.406779 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.406802 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 00:52:53.406906 19312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:38663: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
W20260811 00:52:53.435465 19456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:53.435722 19456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:53.435751 19456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:53.436944 19456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:53.436995 19456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:53.437007 19456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:53.437018 19456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:53.437031 19456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:53.438066 19312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } attempt: 1
I20260811 00:52:53.438562 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.438410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60162)
0811 00:52:53.438478 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.438526 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 00:52:53.438665 19456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:33393,127.26.99.189:41195,127.26.99.188:38663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:38663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.99.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:53.438930 19456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:53.438935 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.438815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60170)
0811 00:52:53.438878 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.438909 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 00:52:53.439070 19312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:38663: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
I20260811 00:52:53.439196 19456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:53.443853 19479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.443837 19466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:53.443830 19465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:53.444092 19456 server_base.cc:1034] running on GCE node
I20260811 00:52:53.444330 19456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:53.444671 19456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:53.445809 19456 hybrid_clock.cc:648] HybridClock initialized: now 1786409573445788 us; error 35 us; skew 500 ppm
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:53.448227 19456 init.cc:377] Logged in from keytab as kudu/127.26.99.188@KRBTEST.COM (short username kudu)
I20260811 00:52:53.448671 19456 webserver.cc:460] Webserver started at http://127.26.99.188:41217/ using document root <none> and password file <none>
I20260811 00:52:53.448880 19456 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:53.448925 19456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:53.449049 19456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:53.450081 19456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data/instance:
uuid: "236de1b317304d0b88aa1ac1edd80997"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "d04088349814d6ef2271d0689145a3e9"
server_key_iv: "97e351c4acdf22a2c7a9249d2e9fdd8b"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.450489 19456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal/instance:
uuid: "236de1b317304d0b88aa1ac1edd80997"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "d04088349814d6ef2271d0689145a3e9"
server_key_iv: "97e351c4acdf22a2c7a9249d2e9fdd8b"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.452517 19456 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 00:52:53.453788 19487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:53.453955 19456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:53.454058 19456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "236de1b317304d0b88aa1ac1edd80997"
format_stamp: "Formatted at 2026-08-11 00:52:53 on dist-test-slave-xt4k"
server_key: "d04088349814d6ef2271d0689145a3e9"
server_key_iv: "97e351c4acdf22a2c7a9249d2e9fdd8b"
server_key_version: "encryptionkey@0"
I20260811 00:52:53.454133 19456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:53.464649 19445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } attempt: 2
I20260811 00:52:53.465148 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.464993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60178)
0811 00:52:53.465059 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.465109 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:52:53.465613 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.465478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60182)
0811 00:52:53.465549 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.465586 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 00:52:53.465734 19445 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:38663: Network error: Client connection negotiation failed: client connection to 127.26.99.188:38663: connect: Connection refused (error 111)
I20260811 00:52:53.467430 19456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:53.470381 19456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:53.470558 19456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:53.475953 19456 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.188:38663
I20260811 00:52:53.475986 19583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.188:38663 every 8 connection(s)
I20260811 00:52:53.476408 19456 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
I20260811 00:52:53.477372 19584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:53.479133 19584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:53.486541 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 19456
I20260811 00:52:53.486655 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786409417711920-27022-0/minicluster-data/master-2/wal/instance
I20260811 00:52:53.486871 27022 external_mini_cluster.cc:1428] Setting key fa6aa21eb23efcc5085bfa42bb6f89c3
I20260811 00:52:53.488601 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.479968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35072 (local address 127.26.99.190:33393)
0811 00:52:53.480025 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.480027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.480247 (+ 220us) server_negotiation.cc:407] Connection header received
0811 00:52:53.480807 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.480808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.480821 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.480878 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.481512 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.481999 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.482976 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.483171 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.483229 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.485348 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.485350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.485350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.485357 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.487011 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.487514 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.487516 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.487516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.487586 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.487816 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.487817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.487817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.487964 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.488037 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.488454 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.488531 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:52:53.488845 19586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.479925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:33393 (local address 127.0.0.1:35072)
0811 00:52:53.480127 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.480165 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.480705 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.480954 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.480958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.481226 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.481428 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.481432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.482082 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.482083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.482895 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.482897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.483239 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.483241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.483370 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.483851 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.483859 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.485266 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.487110 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.487119 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.487121 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.487425 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.487648 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.487648 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.487649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.487758 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.488099 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.488106 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.488255 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.488427 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.488612 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":95,"threads_started":1}
I20260811 00:52:53.489383 19584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:52:53.496417 19586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.489658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41195 (local address 127.0.0.1:51992)
0811 00:52:53.489709 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.489811 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.489942 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.490063 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.490063 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.490205 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.490260 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.490262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.491137 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.491138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.491885 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.491888 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.492235 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.492236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.492308 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.492664 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.492668 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.493971 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.495350 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.495350 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.495351 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.495543 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.495764 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.495765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.495765 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.495823 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.496077 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.496078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.496116 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.496175 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.496275 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 00:52:53.496410 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.489724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51992 (local address 127.26.99.189:41195)
0811 00:52:53.489769 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.489770 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.489931 (+ 161us) server_negotiation.cc:407] Connection header received
0811 00:52:53.490002 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.490003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.490010 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.490054 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.490367 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.491053 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.491974 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.492167 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.492220 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.494055 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.494057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.494057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.494065 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.495282 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.495624 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.495626 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.495626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.495681 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.495892 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.495892 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.495893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.496018 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.496073 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.496220 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.496289 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:52:53.496938 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.487259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.26.99.188:38663)
0811 00:52:53.487457 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.487462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.487484 (+ 22us) server_negotiation.cc:407] Connection header received
0811 00:52:53.487536 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.487538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.487551 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.487609 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.488250 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.489272 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.490476 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.490956 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.491025 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.493708 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.493716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.493717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.493724 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.495154 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.495556 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.495559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.495560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.495646 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.496111 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.496112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.496113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.496273 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.496438 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.496747 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.496827 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":97,"threads_started":1}
I20260811 00:52:53.497008 19584 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:53.504371 19586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.497266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60192)
0811 00:52:53.497344 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.497354 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.497385 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.497490 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.497490 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.497621 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.497653 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.497654 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.498454 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.498456 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.498997 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.498998 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.499384 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.499385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.499430 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.499927 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.499933 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.501586 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.503401 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.503403 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.503403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.503591 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.503773 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.503774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.503774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.503834 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.504037 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.504038 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.504085 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.504160 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.504266 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 00:52:53.504562 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.497282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60192 (local address 127.26.99.188:38663)
0811 00:52:53.497380 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.497381 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.497389 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:52:53.497433 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.497434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.497443 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.497487 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.497716 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.498293 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.499079 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.499319 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.499382 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.501711 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.501713 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.501713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.501727 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.503320 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.503664 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.503665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.503665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.503716 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.503888 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.503889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.503889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.503980 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.504025 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.504184 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.504327 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":79}
I20260811 00:52:53.505213 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.497690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35078 (local address 127.26.99.190:33393)
0811 00:52:53.497733 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.497735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.497742 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:53.497763 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.497764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.497773 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.497818 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.498249 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.498701 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.499324 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.499526 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.499580 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.502289 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.502290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.502291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.502298 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.503866 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.504202 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.504203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.504203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.504269 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.504522 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.504523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.504524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.504655 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.504829 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.505034 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.505126 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:52:53.506286 19584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: Bootstrap starting.
I20260811 00:52:53.507248 19584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:53.507517 19584 log.cc:824] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:53.508224 19584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: No bootstrap required, opened a new log
I20260811 00:52:53.509882 19584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.510061 19584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:53.510102 19584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 236de1b317304d0b88aa1ac1edd80997, State: Initialized, Role: FOLLOWER
I20260811 00:52:53.510228 19584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:52:53.510553 19584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:53.510510 19590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.510674 19590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:52:53.512619 19612 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:52:53.513579 19612 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:52:53.513815 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.506246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52002 (local address 127.26.99.189:41195)
0811 00:52:53.506293 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.506294 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.506302 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:52:53.506323 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.506324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.506333 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.506379 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.506918 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.507411 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.508063 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.508269 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.508322 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.510806 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.510807 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.510808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.510815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.512619 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.512987 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.512988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.512988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.513059 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.513255 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.513256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.513256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.513398 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.513581 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.513636 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.513726 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:52:53.514196 19312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } attempt: 2
I20260811 00:52:53.514032 19456 master_runner.cc:186] Error getting master registration for 127.26.99.190:33393: OK, instance_id { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" instance_seqno: 1786409573172508 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:52:53.517020 19456 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:52:53.517170 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:52:53.521973 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.514436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60208)
0811 00:52:53.514484 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.514493 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.514525 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.514712 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.514714 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.514873 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.514919 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.514921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.515876 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.515877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.516741 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.516744 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.517355 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.517356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.517414 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.517824 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.517828 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.519098 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.520554 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.520555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.520555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.520745 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.521232 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.521233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.521233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.521309 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.521640 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.521641 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.521698 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.521778 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.521875 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 00:52:53.521997 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.514534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60208 (local address 127.26.99.188:38663)
0811 00:52:53.514573 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.514575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.514582 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:53.514601 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.514602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.514612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.514666 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.515002 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.515721 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.516887 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.517175 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.517238 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.519197 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.519198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.519198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.519205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.520471 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.520802 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.520804 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.520804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.520863 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.521377 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.521378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.521379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.521543 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.521611 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.521824 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.521904 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 00:52:53.526221 19312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: Bootstrap starting.
I20260811 00:52:53.527182 19312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:53.527516 19312 log.cc:824] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:53.528715 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.520982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60224 (local address 127.26.99.188:38663)
0811 00:52:53.522061 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.522062 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.522069 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:53.522085 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.522085 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.522094 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.522143 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.522870 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.523564 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.524467 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.524806 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.524855 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.526068 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.526070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.526070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.526076 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.527483 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.527855 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.527856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.527857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.527909 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.528111 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.528112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.528112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.528233 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.528303 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.528553 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.528632 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1065,"thread_start_us":153,"threads_started":1}
I20260811 00:52:53.529472 19317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.520833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35088 (local address 127.26.99.190:33393)
0811 00:52:53.520881 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.520882 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.521253 (+ 371us) server_negotiation.cc:407] Connection header received
0811 00:52:53.521337 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.521338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.521350 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.521377 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.522148 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.522842 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.523576 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.523840 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.523901 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.525825 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.525826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.525827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.525834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.527709 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.528136 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.528137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.528138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.528186 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.528618 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.528619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.528620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.528747 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.528842 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.529307 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.529384 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:52:53.530916 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.521185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52010 (local address 127.26.99.189:41195)
0811 00:52:53.521229 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.521230 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.521237 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:52:53.521255 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.521256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.521266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.521311 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.522155 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.522766 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.523742 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.523939 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.523997 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.528110 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.528111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.528112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.528119 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.529892 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.530214 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.530215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.530215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.530272 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.530449 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.530450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.530450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.530567 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.530661 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.530758 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.530833 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:52:53.537045 19312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: No bootstrap required, opened a new log
I20260811 00:52:53.538560 19312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.538686 19312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:53.538719 19312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be93054c3814cf09773ba97d8e92bbd, State: Initialized, Role: FOLLOWER
I20260811 00:52:53.538852 19312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.539191 19312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:53.539379 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.539561 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:52:53.541316 19650 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:52:53.541373 19650 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:52:53.541814 19187 master_runner.cc:186] Error getting master registration for 127.26.99.189:41195: OK, instance_id { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" instance_seqno: 1786409573321669 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:52:53.544077 19187 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:52:53.556890 19445 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } attempt: 3
Aug 11 00:52:53 dist-test-slave-xt4k krb5kdc[19162](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409573, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:52:53.565162 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.557462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60230 (local address 127.26.99.188:38663)
0811 00:52:53.557516 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:53.557518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:53.557527 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:53.557555 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:53.557556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:53.557566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:53.557624 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:53.557966 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.558725 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.559692 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.559997 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.560066 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.562293 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:53.562294 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:53.562295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:53.562302 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:53.563955 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.564371 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.564372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.564372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.564427 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:53.564653 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:53.564654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:53.564655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:53.564784 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:53.564848 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:53.564991 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 00:52:53.565068 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:52:53.565165 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:53.557163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:38663 (local address 127.0.0.1:60230)
0811 00:52:53.557318 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:53.557329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:53.557389 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:53.557640 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:53.557641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:53.557837 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:53.557893 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.557895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.558803 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.558804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.559609 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:53.559613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:53.560069 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:53.560070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:53.560133 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:53.560659 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:53.560665 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:53.562192 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:53.564058 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.564059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.564060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.564270 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.564506 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:53.564507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:53.564507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:53.564592 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:53.564845 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:53.564846 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:53.564893 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 00:52:53.564961 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 00:52:53.565064 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260811 00:52:53.567212 19445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: Bootstrap starting.
I20260811 00:52:53.567970 19445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:53.568305 19445 log.cc:824] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:53.569298 19445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: No bootstrap required, opened a new log
I20260811 00:52:53.571353 19445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.571525 19445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:53.571583 19445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12be8c6528a54336a18dd77b7efed7eb, State: Initialized, Role: FOLLOWER
I20260811 00:52:53.571774 19445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.572263 19445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:53.573737 19658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.573926 19658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:52:53.574282 19675 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:52:53.574383 19675 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:52:53.576139 19324 master_runner.cc:263] No leader master found from master 12be8c6528a54336a18dd77b7efed7eb
I20260811 00:52:53.576184 19324 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:52:53.620242 19631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:53.620397 19631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.620648 19631 leader_election.cc:288] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12be8c6528a54336a18dd77b7efed7eb (127.26.99.189:41195), 236de1b317304d0b88aa1ac1edd80997 (127.26.99.188:38663)
I20260811 00:52:53.621189 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8be93054c3814cf09773ba97d8e92bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12be8c6528a54336a18dd77b7efed7eb" is_pre_election: true
I20260811 00:52:53.621364 19397 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8be93054c3814cf09773ba97d8e92bbd in term 0.
I20260811 00:52:53.621778 19537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8be93054c3814cf09773ba97d8e92bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "236de1b317304d0b88aa1ac1edd80997" is_pre_election: true
I20260811 00:52:53.621939 19537 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8be93054c3814cf09773ba97d8e92bbd in term 0.
I20260811 00:52:53.622632 19222 leader_election.cc:302] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 236de1b317304d0b88aa1ac1edd80997, 8be93054c3814cf09773ba97d8e92bbd; no voters:
I20260811 00:52:53.622975 19631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:52:53.623054 19631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:52:53.623081 19631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:53.624138 19631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.624253 19631 leader_election.cc:288] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [CANDIDATE]: Term 1 election: Requested vote from peers 12be8c6528a54336a18dd77b7efed7eb (127.26.99.189:41195), 236de1b317304d0b88aa1ac1edd80997 (127.26.99.188:38663)
I20260811 00:52:53.624815 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8be93054c3814cf09773ba97d8e92bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12be8c6528a54336a18dd77b7efed7eb"
I20260811 00:52:53.624895 19397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:53.625795 19397 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be93054c3814cf09773ba97d8e92bbd in term 1.
I20260811 00:52:53.626034 19537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8be93054c3814cf09773ba97d8e92bbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "236de1b317304d0b88aa1ac1edd80997"
I20260811 00:52:53.626132 19537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:53.626967 19537 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8be93054c3814cf09773ba97d8e92bbd in term 1.
I20260811 00:52:53.627254 19222 leader_election.cc:302] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 236de1b317304d0b88aa1ac1edd80997, 8be93054c3814cf09773ba97d8e92bbd; no voters:
I20260811 00:52:53.627532 19631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:53.627681 19631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [term 1 LEADER]: Becoming Leader. State: Replica: 8be93054c3814cf09773ba97d8e92bbd, State: Running, Role: LEADER
I20260811 00:52:53.627770 19631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } }
I20260811 00:52:53.628180 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8be93054c3814cf09773ba97d8e92bbd. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.628268 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:53.632498 19683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:53.632747 19683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:53.634420 19537 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [term 1 FOLLOWER]: Refusing update from remote peer 8be93054c3814cf09773ba97d8e92bbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:53.634830 19679 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:53.636204 19590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8be93054c3814cf09773ba97d8e92bbd. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.636292 19590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:52:53.636731 19397 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [term 1 FOLLOWER]: Refusing update from remote peer 8be93054c3814cf09773ba97d8e92bbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:53.637042 19679 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:53.638255 19658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8be93054c3814cf09773ba97d8e92bbd. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.638343 19658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:52:53.639344 19679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.639421 19679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:53.640358 19658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.640443 19658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:52:53.641011 19685 mvcc.cc:205] Tried to move back new op lower bound from 7317133613604163584 to 7317133613580046336. Current Snapshot: MvccSnapshot[applied={T|T < 7317133613604163584}]
I20260811 00:52:53.641554 19688 mvcc.cc:205] Tried to move back new op lower bound from 7317133613604163584 to 7317133613580046336. Current Snapshot: MvccSnapshot[applied={T|T < 7317133613604163584}]
I20260811 00:52:53.642370 19631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.642467 19631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:53.642863 19590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8be93054c3814cf09773ba97d8e92bbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8be93054c3814cf09773ba97d8e92bbd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 33393 } } peers { permanent_uuid: "12be8c6528a54336a18dd77b7efed7eb" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41195 } } peers { permanent_uuid: "236de1b317304d0b88aa1ac1edd80997" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 38663 } } }
I20260811 00:52:53.642937 19590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:52:53.643661 19683 catalog_manager.cc:1347] Generated new cluster ID: 28ea676104f5499aa71a95f79dacd592
I20260811 00:52:53.643705 19683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:52:53.652782 19686 mvcc.cc:205] Tried to move back new op lower bound from 7317133613604163584 to 7317133613580046336. Current Snapshot: MvccSnapshot[applied={T|T < 7317133613604163584}]
I20260811 00:52:53.672432 19683 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:52:53.673307 19683 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:53.683462 19683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8be93054c3814cf09773ba97d8e92bbd: Generated new TSK 0
I20260811 00:52:53.683755 19683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:52:54.514123 19612 catalog_manager.cc:1259] Loaded cluster ID: 28ea676104f5499aa71a95f79dacd592
I20260811 00:52:54.514200 19612 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: loading cluster ID for follower catalog manager: success
I20260811 00:52:54.515024 19612 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: acquiring CA information for follower catalog manager: success
I20260811 00:52:54.515317 19612 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 236de1b317304d0b88aa1ac1edd80997: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:52:54.574867 19675 catalog_manager.cc:1259] Loaded cluster ID: 28ea676104f5499aa71a95f79dacd592
I20260811 00:52:54.574945 19675 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: loading cluster ID for follower catalog manager: success
I20260811 00:52:54.575753 19675 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: acquiring CA information for follower catalog manager: success
I20260811 00:52:54.576043 19675 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 12be8c6528a54336a18dd77b7efed7eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:52:54.737406 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 19187
I20260811 00:52:54.754631 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 19324
I20260811 00:52:54.771510 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 19456
2026-08-11T00:52:54Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3075 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:52:54 dist-test-slave-xt4k krb5kdc[19707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:52:54 dist-test-slave-xt4k krb5kdc[19707](info): set up 2 sockets
Aug 11 00:52:54 dist-test-slave-xt4k krb5kdc[19707](info): commencing operation
krb5kdc: starting...
W20260811 00:52:55.948958 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:52:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:52:56.067057 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37249
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:34061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:56.147259 19727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:56.147464 19727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:56.147493 19727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:56.148630 19727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:56.148667 19727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:56.148685 19727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:56.148701 19727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:56.148717 19727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:56.150171 19727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:34061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:56.150398 19727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:56.150609 19727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:56.155349 19734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:56.155355 19741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:56.155424 19735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:56.155742 19727 server_base.cc:1034] running on GCE node
I20260811 00:52:56.155982 19727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:56.156243 19727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:56.157380 19727 hybrid_clock.cc:648] HybridClock initialized: now 1786409576157368 us; error 27 us; skew 500 ppm
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409576, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:56.159745 19727 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:56.160138 19727 webserver.cc:460] Webserver started at http://127.26.99.190:41331/ using document root <none> and password file <none>
I20260811 00:52:56.160377 19727 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:56.160429 19727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:56.160563 19727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:56.161545 19727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "534858ebebcf4e8a8eb803714f920b27"
format_stamp: "Formatted at 2026-08-11 00:52:56 on dist-test-slave-xt4k"
server_key: "a89f2a7e163352c04902acd385d53577"
server_key_iv: "8a9ff51175fb4c442988db6859106ad5"
server_key_version: "encryptionkey@0"
I20260811 00:52:56.161862 19727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "534858ebebcf4e8a8eb803714f920b27"
format_stamp: "Formatted at 2026-08-11 00:52:56 on dist-test-slave-xt4k"
server_key: "a89f2a7e163352c04902acd385d53577"
server_key_iv: "8a9ff51175fb4c442988db6859106ad5"
server_key_version: "encryptionkey@0"
I20260811 00:52:56.163079 19727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:52:56.163765 19752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:56.163902 19727 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:52:56.163988 19727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "534858ebebcf4e8a8eb803714f920b27"
format_stamp: "Formatted at 2026-08-11 00:52:56 on dist-test-slave-xt4k"
server_key: "a89f2a7e163352c04902acd385d53577"
server_key_iv: "8a9ff51175fb4c442988db6859106ad5"
server_key_version: "encryptionkey@0"
I20260811 00:52:56.164053 19727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:56.190302 19727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:56.192159 19727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:56.192286 19727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:56.196164 19727 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37249
I20260811 00:52:56.196220 19838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37249 every 8 connection(s)
I20260811 00:52:56.196542 19727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:56.197351 19839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:56.199610 19839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27: Bootstrap starting.
I20260811 00:52:56.200148 19839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:56.200457 19839 log.cc:824] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:56.201130 19839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27: No bootstrap required, opened a new log
I20260811 00:52:56.201696 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 19727
I20260811 00:52:56.201807 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:52:56.202020 27022 external_mini_cluster.cc:1428] Setting key 82b500543c1978ea632886f9afff1f5d
I20260811 00:52:56.203064 19839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } }
I20260811 00:52:56.203197 19839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:56.203229 19839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 534858ebebcf4e8a8eb803714f920b27, State: Initialized, Role: FOLLOWER
I20260811 00:52:56.203362 19839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } }
I20260811 00:52:56.203424 19839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:56.203454 19839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:56.203511 19839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:56.204432 19839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } }
I20260811 00:52:56.204535 19839 leader_election.cc:302] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 534858ebebcf4e8a8eb803714f920b27; no voters:
I20260811 00:52:56.204691 19839 leader_election.cc:288] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:52:56.204712 19847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:56.204890 19847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [term 1 LEADER]: Becoming Leader. State: Replica: 534858ebebcf4e8a8eb803714f920b27, State: Running, Role: LEADER
I20260811 00:52:56.205003 19839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:56.205027 19847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } }
I20260811 00:52:56.205392 19854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "534858ebebcf4e8a8eb803714f920b27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } } }
I20260811 00:52:56.205610 19854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:56.205546 19851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 534858ebebcf4e8a8eb803714f920b27. Latest consensus state: current_term: 1 leader_uuid: "534858ebebcf4e8a8eb803714f920b27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534858ebebcf4e8a8eb803714f920b27" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37249 } } }
I20260811 00:52:56.205833 19851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:56.205938 19858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:56.206375 19858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:56.207996 19858 catalog_manager.cc:1347] Generated new cluster ID: 730fbe9357da4459bb9b41d52b015702
I20260811 00:52:56.208050 19858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:56.212186 19843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:56.202505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.26.99.190:37249)
0811 00:52:56.202677 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:56.202686 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:56.202714 (+ 28us) server_negotiation.cc:407] Connection header received
0811 00:52:56.203034 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:56.203040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:56.203083 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:56.203198 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:56.204018 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:56.205328 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:56.206405 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:56.206973 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:56.207091 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:56.209374 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:56.209378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:56.209378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:56.209390 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:56.210837 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:56.211156 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:56.211160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:56.211160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:56.211258 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:56.211432 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:56.211433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:56.211433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:56.211655 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:56.211814 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:56.211884 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 00:52:56.212029 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260811 00:52:56.213100 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:52:56.217624 19858 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:52:56.218112 19858 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:56.221769 19858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 534858ebebcf4e8a8eb803714f920b27: Generated new TSK 0
I20260811 00:52:56.221918 19858 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:52:56.266719 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 19727
2026-08-11T00:52:56Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1499 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19886](info): set up 2 sockets
Aug 11 00:52:56 dist-test-slave-xt4k krb5kdc[19886](info): commencing operation
krb5kdc: starting...
W20260811 00:52:57.465641 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:52:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:52:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:52:57.580647 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:46859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:57.661381 19907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:57.661598 19907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:57.661630 19907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:57.662762 19907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:57.662803 19907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:57.662822 19907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:57.662838 19907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:57.662854 19907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:57.664321 19907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:46859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:57.664573 19907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:57.664780 19907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:57.669555 19914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:57.669581 19915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:57.669574 19919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:57.669667 19907 server_base.cc:1034] running on GCE node
I20260811 00:52:57.670122 19907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:57.670413 19907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:57.671561 19907 hybrid_clock.cc:648] HybridClock initialized: now 1786409577671543 us; error 30 us; skew 500 ppm
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:57.674028 19907 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:57.674449 19907 webserver.cc:460] Webserver started at http://127.26.99.190:46293/ using document root <none> and password file <none>
I20260811 00:52:57.674655 19907 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:57.674695 19907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:57.674783 19907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:57.675796 19907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "419fad4511c74f31938c61b521e6a532"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "597b94e76abe35d7840e235c2e3a541e"
server_key_iv: "7c4ed94c3695571f31a63a72353c05d2"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.676084 19907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "419fad4511c74f31938c61b521e6a532"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "597b94e76abe35d7840e235c2e3a541e"
server_key_iv: "7c4ed94c3695571f31a63a72353c05d2"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.677346 19907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:52:57.678117 19933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:57.678274 19907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:52:57.678360 19907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "419fad4511c74f31938c61b521e6a532"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "597b94e76abe35d7840e235c2e3a541e"
server_key_iv: "7c4ed94c3695571f31a63a72353c05d2"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.678416 19907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:57.691042 19907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:57.693065 19907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:57.693174 19907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:57.696869 19907 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:46859
I20260811 00:52:57.696919 20025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:46859 every 8 connection(s)
I20260811 00:52:57.697229 19907 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:57.698190 20026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:57.700475 20026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap starting.
I20260811 00:52:57.701035 20026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:57.701284 20026 log.cc:824] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:57.702006 20026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: No bootstrap required, opened a new log
I20260811 00:52:57.703598 20026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:57.703734 20026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:57.703756 20026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Initialized, Role: FOLLOWER
I20260811 00:52:57.703881 20026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:57.703945 20026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:57.703972 20026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:57.704002 20026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:57.704836 20026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:57.704926 20026 leader_election.cc:302] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 419fad4511c74f31938c61b521e6a532; no voters:
I20260811 00:52:57.705101 20026 leader_election.cc:288] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:52:57.705140 20033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:57.705303 20033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 LEADER]: Becoming Leader. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Running, Role: LEADER
I20260811 00:52:57.705533 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 19907
I20260811 00:52:57.705622 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:52:57.705807 27022 external_mini_cluster.cc:1428] Setting key 7351becd40941ffdae24097604107e34
I20260811 00:52:57.705345 20026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:57.706038 20033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:57.706584 20034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:57.706756 20035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 419fad4511c74f31938c61b521e6a532. Latest consensus state: current_term: 1 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:57.706825 20034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:57.706912 20035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:57.707077 20054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:57.707602 20054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:57.709280 20054 catalog_manager.cc:1347] Generated new cluster ID: e19ebff21c474d9ab274488e05af99b7
I20260811 00:52:57.709334 20054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:57.717190 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:57.706231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53868 (local address 127.26.99.190:46859)
0811 00:52:57.706659 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:57.706668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:57.706700 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:52:57.706808 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:57.706814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:57.706869 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:57.707017 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:57.707985 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.709200 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.710248 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.710887 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.711016 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:57.713682 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:57.713686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:57.713687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:57.713699 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:57.715573 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:57.715935 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:57.715938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:57.715938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:57.716067 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:57.716242 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:57.716243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:57.716243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:57.716591 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:57.716767 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:57.716836 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:52:57.716983 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":86,"threads_started":1}
I20260811 00:52:57.719862 20054 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:52:57.720600 20054 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:57.724730 20054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Generated new TSK 0
I20260811 00:52:57.724889 20054 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:52:57.752821 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:57.833541 20076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:57.833724 20076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:57.833746 20076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:57.834797 20076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:57.834828 20076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:57.834852 20076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:57.836239 20076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:57.836440 20076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:57.836630 20076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:57.841256 20091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:57.841291 20086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:57.841256 20084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:57.841459 20076 server_base.cc:1034] running on GCE node
I20260811 00:52:57.841715 20076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:57.841929 20076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:57.843062 20076 hybrid_clock.cc:648] HybridClock initialized: now 1786409577843047 us; error 31 us; skew 500 ppm
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:57.845541 20076 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:57.845953 20076 webserver.cc:460] Webserver started at http://127.26.99.129:42541/ using document root <none> and password file <none>
I20260811 00:52:57.846170 20076 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:57.846215 20076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:57.846338 20076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:57.847299 20076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "2ad52722829f4e3d8f4efbf057de7efa"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "7d8c6774c7051d1475b5484b26747c49"
server_key_iv: "c0b11b022d19d0e8835ec52bd0f1a97a"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.847644 20076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "2ad52722829f4e3d8f4efbf057de7efa"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "7d8c6774c7051d1475b5484b26747c49"
server_key_iv: "c0b11b022d19d0e8835ec52bd0f1a97a"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.848960 20076 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:52:57.849573 20109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:57.849706 20076 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:52:57.849787 20076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "2ad52722829f4e3d8f4efbf057de7efa"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "7d8c6774c7051d1475b5484b26747c49"
server_key_iv: "c0b11b022d19d0e8835ec52bd0f1a97a"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.849845 20076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:57.865267 20076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:57.867225 20076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:57.867347 20076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:57.867553 20076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:57.867830 20076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:57.867862 20076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:57.867888 20076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:57.867913 20076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:57.873202 20076 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36525
I20260811 00:52:57.873253 20307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36525 every 8 connection(s)
I20260811 00:52:57.873523 20076 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:52:57.877820 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 20076
I20260811 00:52:57.877933 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:52:57.878154 27022 external_mini_cluster.cc:1428] Setting key 57a64d5eed2f373e5f9f62610c5e5663
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:57.882534 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:57.874168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:33293 (local address 127.26.99.190:46859)
0811 00:52:57.874224 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:57.874226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:57.874416 (+ 190us) server_negotiation.cc:407] Connection header received
0811 00:52:57.874924 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:57.874925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:57.874939 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:57.874997 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:57.875866 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.876437 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.877371 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.877576 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.877630 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:57.879844 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:57.879845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:57.879845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:57.879853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:57.881271 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:57.881630 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:57.881631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:57.881632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:57.881688 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:57.881899 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:57.881900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:57.881901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:57.882009 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:57.882065 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:57.882341 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 00:52:57.882446 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:52:57.882686 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:57.874138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:33293)
0811 00:52:57.874293 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:57.874332 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:57.874833 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:57.875054 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:57.875057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:57.875587 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:57.875767 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:57.875771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.876526 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.876527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:57.877294 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:57.877296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:57.877658 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:57.877659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:57.877796 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:57.878351 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:57.878360 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:57.879757 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:57.881349 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:57.881356 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:57.881358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:57.881567 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:57.881742 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:57.881742 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:57.881743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:57.881846 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:57.882062 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:57.882069 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:57.882224 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 00:52:57.882312 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:52:57.882482 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260811 00:52:57.883332 20309 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:57.883423 20309 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:57.883599 20309 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:57.884176 19957 ts_manager.cc:194] Registered new tserver with Master: 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
I20260811 00:52:57.885082 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:33293
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:52:57.903209 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:57.984746 20318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:57.984957 20318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:57.984989 20318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:57.986117 20318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:57.986159 20318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:57.986195 20318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:57.987658 20318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:57.987895 20318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:57.988112 20318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:57.992936 20328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:57.992960 20325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:57.993124 20318 server_base.cc:1034] running on GCE node
W20260811 00:52:57.993211 20326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:57.993425 20318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:57.993702 20318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:57.994853 20318 hybrid_clock.cc:648] HybridClock initialized: now 1786409577994841 us; error 30 us; skew 500 ppm
Aug 11 00:52:57 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:57.997393 20318 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:57.997831 20318 webserver.cc:460] Webserver started at http://127.26.99.130:45913/ using document root <none> and password file <none>
I20260811 00:52:57.998073 20318 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:57.998123 20318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:57.998245 20318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:57.999276 20318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "f67f1c5d64874e6f82baf01c1602aae5"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "4bb053dcd3ae0879d8f0fdfb50f69b32"
server_key_iv: "d153ffb4f45aa0451f6bf2fefd4d1fdb"
server_key_version: "encryptionkey@0"
I20260811 00:52:57.999683 20318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "f67f1c5d64874e6f82baf01c1602aae5"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "4bb053dcd3ae0879d8f0fdfb50f69b32"
server_key_iv: "d153ffb4f45aa0451f6bf2fefd4d1fdb"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.001014 20318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 00:52:58.001716 20341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.001888 20318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:58.001976 20318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "f67f1c5d64874e6f82baf01c1602aae5"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "4bb053dcd3ae0879d8f0fdfb50f69b32"
server_key_iv: "d153ffb4f45aa0451f6bf2fefd4d1fdb"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.002039 20318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:58.026875 20318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:58.029109 20318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:58.029253 20318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:58.029480 20318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:58.029806 20318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:58.029841 20318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.029871 20318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:58.029893 20318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.035647 20318 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:36417
I20260811 00:52:58.035712 20533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:36417 every 8 connection(s)
I20260811 00:52:58.036011 20318 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:52:58.038687 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 20318
I20260811 00:52:58.038780 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:52:58.038954 27022 external_mini_cluster.cc:1428] Setting key 619a79f6f9842253f2dad7d17adcb118
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409577, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:58.045595 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.036833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:48837 (local address 127.26.99.190:46859)
0811 00:52:58.036912 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.036915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.037071 (+ 156us) server_negotiation.cc:407] Connection header received
0811 00:52:58.037573 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.037574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.037585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.037644 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.038559 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.039174 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.040472 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.040670 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.040726 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.042819 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.042820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.042820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.042828 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.044316 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.044713 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.044714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.044714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.044781 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.044984 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.044984 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.044985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.045121 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.045192 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.045403 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.045502 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 00:52:58.045647 20540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.036783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:48837)
0811 00:52:58.036943 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.036983 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.037467 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.037709 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.037712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.038269 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:58.038462 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.038467 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.039248 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.039250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.040396 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.040400 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.040748 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.040749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.040884 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.041388 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:58.041398 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:58.042725 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:58.044418 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.044425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.044427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.044640 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.044843 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.044843 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.044844 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.044928 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.045177 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:58.045180 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:58.045288 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.045364 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.045481 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260811 00:52:58.046080 20536 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:58.046191 20536 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:58.046391 20536 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:58.046813 19957 ts_manager.cc:194] Registered new tserver with Master: f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417)
I20260811 00:52:58.047195 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:48837
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:52:58.062589 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:58.142540 20545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:58.142743 20545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:58.142774 20545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:58.143898 20545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:58.143940 20545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:58.143975 20545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:58.145476 20545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:58.145705 20545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:58.145910 20545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:58.150760 20563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.150731 20558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.150743 20555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:58.150975 20545 server_base.cc:1034] running on GCE node
I20260811 00:52:58.151178 20545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:58.151391 20545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:58.152557 20545 hybrid_clock.cc:648] HybridClock initialized: now 1786409578152540 us; error 30 us; skew 500 ppm
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:58.159687 20545 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:58.160116 20545 webserver.cc:460] Webserver started at http://127.26.99.131:44989/ using document root <none> and password file <none>
I20260811 00:52:58.160315 20545 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:58.160386 20545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:58.160521 20545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:52:58.161536 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "ebb662cf92af421c845573c28d064850"
format_stamp: "Formatted at 2026-08-11 00:52:58 on dist-test-slave-xt4k"
server_key: "d68f585ebed2f778c996129a97fc5a92"
server_key_iv: "6bef51394f4c3470d7285f36b3602547"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.161856 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "ebb662cf92af421c845573c28d064850"
format_stamp: "Formatted at 2026-08-11 00:52:58 on dist-test-slave-xt4k"
server_key: "d68f585ebed2f778c996129a97fc5a92"
server_key_iv: "6bef51394f4c3470d7285f36b3602547"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.163093 20545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:52:58.163731 20574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.163880 20545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:58.163966 20545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "ebb662cf92af421c845573c28d064850"
format_stamp: "Formatted at 2026-08-11 00:52:58 on dist-test-slave-xt4k"
server_key: "d68f585ebed2f778c996129a97fc5a92"
server_key_iv: "6bef51394f4c3470d7285f36b3602547"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.164027 20545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:58.175402 20545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:58.177138 20545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:58.177265 20545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:58.177469 20545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:58.177749 20545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:58.177783 20545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.177809 20545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:58.177831 20545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.183321 20545 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:33833
I20260811 00:52:58.183387 20777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:33833 every 8 connection(s)
I20260811 00:52:58.183660 20545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:52:58.187337 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 20545
I20260811 00:52:58.187428 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:52:58.187618 27022 external_mini_cluster.cc:1428] Setting key fca5727494f8dd52e3bc38b0bdd670b8
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:58.192384 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.184407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:56183 (local address 127.26.99.190:46859)
0811 00:52:58.184454 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.184456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.184636 (+ 180us) server_negotiation.cc:407] Connection header received
0811 00:52:58.185091 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.185092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.185101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.185157 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.186058 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.186549 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.187661 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.187930 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.187981 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.190115 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.190117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.190117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.190124 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.191361 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.191700 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.191700 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.191701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.191746 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.191905 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.191906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.191906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.191998 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.192042 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.192236 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.192290 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:52:58.192570 20780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.184371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:56183)
0811 00:52:58.184518 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.184558 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.185015 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.185212 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.185215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.185766 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:58.185958 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.185963 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.186617 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.186618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.187582 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.187586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.187997 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.187998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.188148 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.188623 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:58.188632 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:58.190019 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:58.191429 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.191434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.191436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.191643 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.191784 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.191785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.191785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.191866 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.192042 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:58.192044 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:58.192149 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.192223 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.192361 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260811 00:52:58.192973 20778 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:58.193064 20778 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:58.193228 20778 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:58.193558 19957 ts_manager.cc:194] Registered new tserver with Master: ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
I20260811 00:52:58.193920 19957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:56183
I20260811 00:52:58.199335 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:52:58.205906 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.200638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53872 (local address 127.26.99.190:46859)
0811 00:52:58.200713 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.200715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.200809 (+ 94us) server_negotiation.cc:407] Connection header received
0811 00:52:58.200848 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.200848 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.200856 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.200900 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.201370 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.201881 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.202571 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.202752 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.202804 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.203727 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.203728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.203728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.203734 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.204959 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.205220 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.205221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.205221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.205265 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.205381 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.205381 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.205382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.205552 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.205641 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.205730 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.205802 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:52:58.207458 19957 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:52:58.209085 19957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:52:58.214857 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.210954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.0.0.1:46724)
0811 00:52:58.211061 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.211098 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.211158 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.211552 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.211555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.211556 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:58.211620 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.211622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212914 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.212915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.213681 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.213684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214594 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.214674 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.214689 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.214732 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.214784 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":64,"threads_started":1}
I20260811 00:52:58.214957 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.210959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:36417 (local address 127.0.0.1:60734)
0811 00:52:58.211357 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.211366 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.211419 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.211644 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.211645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.211647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:58.211723 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.211725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212971 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.212972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.214023 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.214025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214666 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.214740 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.214744 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.214791 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.214832 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":58,"threads_started":1}
I20260811 00:52:58.215119 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.211125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55210 (local address 127.26.99.131:33833)
0811 00:52:58.211457 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.211461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.211470 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:58.211531 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.211533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.211549 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.211619 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:58.211813 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212587 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.213953 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214627 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214682 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.214735 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.215003 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.215047 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":89,"threads_started":1}
I20260811 00:52:58.215147 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.210954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33833 (local address 127.0.0.1:55210)
0811 00:52:58.211289 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.211298 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.211348 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.211678 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.211679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.211681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:58.211744 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.211745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212677 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.212678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.213872 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.213875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214766 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.214820 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.214824 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.214867 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.214903 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":53,"thread_start_us":64,"threads_started":1}
I20260811 00:52:58.214926 20802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.211191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60734 (local address 127.26.99.130:36417)
0811 00:52:58.211334 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.211339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.211410 (+ 71us) server_negotiation.cc:407] Connection header received
0811 00:52:58.211475 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.211479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.211494 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.211562 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:58.211807 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212879 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214096 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214587 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.214652 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.214714 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.214804 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.214846 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260811 00:52:58.215435 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.211199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46724 (local address 127.26.99.129:36525)
0811 00:52:58.211389 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.211393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.211402 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:58.211439 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.211442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.211457 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.211548 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:58.211678 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.212799 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.213773 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.214494 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.215247 (+ 753us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.215294 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.215317 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.215359 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":81,"threads_started":1}
I20260811 00:52:58.215835 20425 tablet_service.cc:1467] Processing CreateTablet for tablet 468495f863064ad7a9926cd97478bebf (DEFAULT_TABLE table=test-table [id=ad16fad9f50847d4b36575f9c4c5999e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:58.215837 20662 tablet_service.cc:1467] Processing CreateTablet for tablet 468495f863064ad7a9926cd97478bebf (DEFAULT_TABLE table=test-table [id=ad16fad9f50847d4b36575f9c4c5999e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:58.216200 20425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 468495f863064ad7a9926cd97478bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:58.216200 20662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 468495f863064ad7a9926cd97478bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:58.219468 20804 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Bootstrap starting.
I20260811 00:52:58.220227 20804 tablet_bootstrap.cc:654] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:58.220115 20198 tablet_service.cc:1467] Processing CreateTablet for tablet 468495f863064ad7a9926cd97478bebf (DEFAULT_TABLE table=test-table [id=ad16fad9f50847d4b36575f9c4c5999e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:58.220469 20198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 468495f863064ad7a9926cd97478bebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:58.220475 20809 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Bootstrap starting.
I20260811 00:52:58.220829 20804 log.cc:824] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:58.221091 20809 tablet_bootstrap.cc:654] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:58.221612 20809 log.cc:824] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:58.221715 20804 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: No bootstrap required, opened a new log
I20260811 00:52:58.221807 20804 ts_tablet_manager.cc:1397] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:52:58.222261 20809 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: No bootstrap required, opened a new log
I20260811 00:52:58.222324 20809 ts_tablet_manager.cc:1397] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:58.223656 20809 raft_consensus.cc:348] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.223814 20809 raft_consensus.cc:374] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:58.223852 20809 raft_consensus.cc:729] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb662cf92af421c845573c28d064850, State: Initialized, Role: FOLLOWER
I20260811 00:52:58.223982 20813 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap starting.
I20260811 00:52:58.223984 20809 consensus_queue.cc:260] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.224002 20804 raft_consensus.cc:348] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.224164 20804 raft_consensus.cc:374] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:58.224210 20804 raft_consensus.cc:729] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67f1c5d64874e6f82baf01c1602aae5, State: Initialized, Role: FOLLOWER
I20260811 00:52:58.224295 20809 ts_tablet_manager.cc:1428] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:58.224371 20804 consensus_queue.cc:260] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.224436 20778 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
I20260811 00:52:58.224637 20813 tablet_bootstrap.cc:654] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:58.224692 20536 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
I20260811 00:52:58.224678 20804 ts_tablet_manager.cc:1428] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 00:52:58.225281 20813 log.cc:824] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:58.225977 20813 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: No bootstrap required, opened a new log
I20260811 00:52:58.226044 20813 ts_tablet_manager.cc:1397] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:52:58.227447 20813 raft_consensus.cc:348] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.227566 20813 raft_consensus.cc:374] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:58.227597 20813 raft_consensus.cc:729] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad52722829f4e3d8f4efbf057de7efa, State: Initialized, Role: FOLLOWER
I20260811 00:52:58.227699 20813 consensus_queue.cc:260] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.227918 20813 ts_tablet_manager.cc:1428] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:52:58.227969 20309 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
W20260811 00:52:58.286701 20539 tablet.cc:2369] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:52:58.374217 20310 tablet.cc:2369] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:52:58.431067 20816 raft_consensus.cc:482] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:58.431202 20816 raft_consensus.cc:504] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.431556 20816 leader_election.cc:288] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebb662cf92af421c845573c28d064850 (127.26.99.131:33833), 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
W20260811 00:52:58.434171 20779 tablet.cc:2369] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:52:58.435551 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.431774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33833 (local address 127.26.99.130:37257)
0811 00:52:58.431974 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.431983 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.432029 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.432143 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.432143 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.432144 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:58.432196 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.432197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.433137 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.433137 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.434468 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.434471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.435278 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.435280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.435351 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.435355 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.435410 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.435455 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":85,"thread_start_us":99,"threads_started":1}
I20260811 00:52:58.435557 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.431900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37257 (local address 127.26.99.131:33833)
0811 00:52:58.432030 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.432032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.432054 (+ 22us) server_negotiation.cc:407] Connection header received
0811 00:52:58.432079 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.432079 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.432088 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.432135 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:58.432296 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.433069 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.434568 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.435148 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.435219 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.435228 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.435430 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.435499 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 00:52:58.435596 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.431905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:45911 (local address 127.26.99.129:36525)
0811 00:52:58.431949 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.431951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.431962 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:52:58.431994 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.431995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.432005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.432061 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:58.432269 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.433061 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.434568 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.435148 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.435219 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.435228 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.435494 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.435538 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:52:58.435711 20540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.431774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.26.99.130:45911)
0811 00:52:58.431861 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.431874 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.431940 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.432085 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.432086 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.432087 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:58.432168 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.432171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.433137 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.433137 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.434476 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.434477 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.435216 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.435218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.435311 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.435315 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.435369 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.435412 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":43}
I20260811 00:52:58.435979 20698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "468495f863064ad7a9926cd97478bebf" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb662cf92af421c845573c28d064850" is_pre_election: true
I20260811 00:52:58.436000 20230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "468495f863064ad7a9926cd97478bebf" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad52722829f4e3d8f4efbf057de7efa" is_pre_election: true
I20260811 00:52:58.436142 20230 raft_consensus.cc:2454] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 0.
I20260811 00:52:58.436142 20698 raft_consensus.cc:2454] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 0.
I20260811 00:52:58.436379 20342 leader_election.cc:302] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5; no voters:
I20260811 00:52:58.436530 20816 raft_consensus.cc:2781] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:52:58.436595 20816 raft_consensus.cc:482] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:52:58.436610 20816 raft_consensus.cc:3037] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:58.437299 20816 raft_consensus.cc:504] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.437422 20816 leader_election.cc:288] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 election: Requested vote from peers ebb662cf92af421c845573c28d064850 (127.26.99.131:33833), 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
I20260811 00:52:58.437568 20230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "468495f863064ad7a9926cd97478bebf" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad52722829f4e3d8f4efbf057de7efa"
I20260811 00:52:58.437597 20698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "468495f863064ad7a9926cd97478bebf" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb662cf92af421c845573c28d064850"
I20260811 00:52:58.437644 20230 raft_consensus.cc:3037] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:58.437659 20698 raft_consensus.cc:3037] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:58.438337 20230 raft_consensus.cc:2454] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 1.
I20260811 00:52:58.438386 20698 raft_consensus.cc:2454] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 1.
I20260811 00:52:58.438544 20342 leader_election.cc:302] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5; no voters:
I20260811 00:52:58.438629 20816 raft_consensus.cc:2781] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:58.438771 20816 raft_consensus.cc:686] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 1 LEADER]: Becoming Leader. State: Replica: f67f1c5d64874e6f82baf01c1602aae5, State: Running, Role: LEADER
I20260811 00:52:58.438859 20816 consensus_queue.cc:237] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.439728 19957 catalog_manager.cc:5495] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "f67f1c5d64874e6f82baf01c1602aae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } health_report { overall_health: UNKNOWN } } }
I20260811 00:52:58.495646 20802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.493517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60742 (local address 127.26.99.130:36417)
0811 00:52:58.493569 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.493571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.493590 (+ 19us) server_negotiation.cc:407] Connection header received
0811 00:52:58.493627 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.493628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.493646 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.493703 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:52:58.493812 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.494300 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.494997 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.495192 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.495246 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.495356 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:52:58.495451 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:52:58.495506 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.495537 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.495554 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:52:58.497390 20698 raft_consensus.cc:1261] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Refusing update from remote peer f67f1c5d64874e6f82baf01c1602aae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:58.497390 20230 raft_consensus.cc:1261] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Refusing update from remote peer f67f1c5d64874e6f82baf01c1602aae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:58.497743 20821 consensus_queue.cc:1035] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:58.497869 20816 consensus_queue.cc:1035] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:58.502691 19956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:58.502779 19956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:58.503479 19956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Sending DeleteTablet for 3 replicas of tablet 468495f863064ad7a9926cd97478bebf
I20260811 00:52:58.503782 20425 tablet_service.cc:1514] Processing DeleteTablet for tablet 468495f863064ad7a9926cd97478bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:58 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:60734
I20260811 00:52:58.503772 20662 tablet_service.cc:1514] Processing DeleteTablet for tablet 468495f863064ad7a9926cd97478bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:58 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55210
I20260811 00:52:58.504007 20850 tablet_replica.cc:330] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: stopping tablet replica
I20260811 00:52:58.504019 20198 tablet_service.cc:1514] Processing DeleteTablet for tablet 468495f863064ad7a9926cd97478bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:58 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46724
I20260811 00:52:58.504169 20850 raft_consensus.cc:2229] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:58.504210 20851 tablet_replica.cc:330] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: stopping tablet replica
I20260811 00:52:58.504225 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 20076
I20260811 00:52:58.504307 20850 raft_consensus.cc:2258] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:58.519603 20850 ts_tablet_manager.cc:1905] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:58.521490 20849 tablet_replica.cc:330] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: stopping tablet replica
I20260811 00:52:58.521653 20850 ts_tablet_manager.cc:1918] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:58.521713 20849 raft_consensus.cc:2229] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:52:58.521778 20850 log.cc:1196] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/468495f863064ad7a9926cd97478bebf
I20260811 00:52:58.521987 20849 raft_consensus.cc:2258] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:58.522061 20850 ts_tablet_manager.cc:1939] T 468495f863064ad7a9926cd97478bebf P ebb662cf92af421c845573c28d064850: Deleting consensus metadata
I20260811 00:52:58.522600 19935 catalog_manager.cc:4841] TS ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): tablet 468495f863064ad7a9926cd97478bebf (table test-table [id=ad16fad9f50847d4b36575f9c4c5999e]) successfully deleted
I20260811 00:52:58.522650 20849 ts_tablet_manager.cc:1905] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:58.524191 20849 ts_tablet_manager.cc:1918] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:58.524262 20849 log.cc:1196] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/468495f863064ad7a9926cd97478bebf
I20260811 00:52:58.524519 20849 ts_tablet_manager.cc:1939] T 468495f863064ad7a9926cd97478bebf P f67f1c5d64874e6f82baf01c1602aae5: Deleting consensus metadata
I20260811 00:52:58.524943 19939 catalog_manager.cc:4841] TS f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): tablet 468495f863064ad7a9926cd97478bebf (table test-table [id=ad16fad9f50847d4b36575f9c4c5999e]) successfully deleted
W20260811 00:52:58.525621 19938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:36525 (error 108)
I20260811 00:52:58.526137 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.526004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.0.0.1:46730)
0811 00:52:58.526057 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.526103 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 00:52:58.526140 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 20318
W20260811 00:52:58.529068 19938 catalog_manager.cc:4584] TS 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 468495f863064ad7a9926cd97478bebf: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36525: connect: Connection refused (error 111)
I20260811 00:52:58.534829 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 20545
I20260811 00:52:58.546320 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 19907
I20260811 00:52:58.554877 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--webserver_interface=127.26.99.190
--webserver_port=46293
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:46859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:58.634851 20855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:58.635046 20855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:58.635066 20855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:58.636155 20855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:58.636193 20855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:58.636206 20855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:58.636219 20855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:58.636242 20855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:58.637712 20855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:46859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=46293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:58.637931 20855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:58.638137 20855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:58.648519 20867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.648540 20871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.648538 20869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:58.648756 20855 server_base.cc:1034] running on GCE node
I20260811 00:52:58.649026 20855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:58.649313 20855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:58.650461 20855 hybrid_clock.cc:648] HybridClock initialized: now 1786409578650458 us; error 32 us; skew 500 ppm
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:58.652908 20855 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:58.653355 20855 webserver.cc:460] Webserver started at http://127.26.99.190:46293/ using document root <none> and password file <none>
I20260811 00:52:58.653570 20855 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:58.653633 20855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:58.654896 20855 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:58.655541 20884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.655710 20855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.655798 20855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "419fad4511c74f31938c61b521e6a532"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "597b94e76abe35d7840e235c2e3a541e"
server_key_iv: "7c4ed94c3695571f31a63a72353c05d2"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.656158 20855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:58.669891 20855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:58.671710 20855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:58.671842 20855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:58.676013 20855 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:46859
I20260811 00:52:58.676050 20974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:46859 every 8 connection(s)
I20260811 00:52:58.676469 20855 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:58.678045 20975 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:52:58.678654 20975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap starting.
I20260811 00:52:58.679790 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 20855
I20260811 00:52:58.680040 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:36525
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=42541
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:58.687033 20975 log.cc:824] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:58.688980 20975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:52:58.689251 20975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap complete.
I20260811 00:52:58.691387 20975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:58.691613 20975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Initialized, Role: FOLLOWER
I20260811 00:52:58.691764 20975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:58.691838 20975 raft_consensus.cc:388] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:58.691900 20975 raft_consensus.cc:482] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:58.691947 20975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:52:58.693038 20975 raft_consensus.cc:504] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:58.693140 20975 leader_election.cc:302] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 419fad4511c74f31938c61b521e6a532; no voters:
I20260811 00:52:58.693295 20975 leader_election.cc:288] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:52:58.693358 20983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:52:58.693544 20975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:58.693557 20983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 LEADER]: Becoming Leader. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Running, Role: LEADER
I20260811 00:52:58.693807 20983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:58.694200 20984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:58.694279 20984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:58.694187 20985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 419fad4511c74f31938c61b521e6a532. Latest consensus state: current_term: 2 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:58.694471 20985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:58.694590 20998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:58.695398 20998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:58.695549 20998 catalog_manager.cc:1259] Loaded cluster ID: e19ebff21c474d9ab274488e05af99b7
I20260811 00:52:58.695822 20998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:52:58.696127 20998 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 00:52:58.700774 20998 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 00:52:58.703227 20998 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:52:58.703424 20998 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Loaded TSK: 0
I20260811 00:52:58.703644 20998 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:52:58.762982 20978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:58.763170 20978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:58.763190 20978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:58.764314 20978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:58.764385 20978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:58.764424 20978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:58.765901 20978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:36525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=42541
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:58.766129 20978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:58.766327 20978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:58.771286 21020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.771328 21024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.771301 21019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:58.771734 20978 server_base.cc:1034] running on GCE node
I20260811 00:52:58.771971 20978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:58.772258 20978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:58.773433 20978 hybrid_clock.cc:648] HybridClock initialized: now 1786409578773419 us; error 44 us; skew 500 ppm
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:58.776371 20978 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:58.776805 20978 webserver.cc:460] Webserver started at http://127.26.99.129:42541/ using document root <none> and password file <none>
I20260811 00:52:58.777006 20978 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:58.777070 20978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:58.778405 20978 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:58.779098 21036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.779263 20978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:58.779353 20978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "2ad52722829f4e3d8f4efbf057de7efa"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "7d8c6774c7051d1475b5484b26747c49"
server_key_iv: "c0b11b022d19d0e8835ec52bd0f1a97a"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.779716 20978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:58.816629 20978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:58.818728 20978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:58.818851 20978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:58.819092 20978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:58.819512 21051 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:52:58.821346 20978 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:52:58.821394 20978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:52:58.821429 20978 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:52:58.822081 20978 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:52:58.822115 20978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:52:58.822163 21051 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap starting.
I20260811 00:52:58.828323 20978 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36525
I20260811 00:52:58.828450 21231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36525 every 8 connection(s)
I20260811 00:52:58.828732 20978 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:52:58.831779 21051 log.cc:824] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:58.834089 21051 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:52:58.834373 21051 tablet_bootstrap.cc:492] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap complete.
I20260811 00:52:58.835156 21051 ts_tablet_manager.cc:1397] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:58.835882 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 20978
I20260811 00:52:58.836153 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:36417
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=45913
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:58.836277 21051 raft_consensus.cc:348] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.836602 21051 raft_consensus.cc:729] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad52722829f4e3d8f4efbf057de7efa, State: Initialized, Role: FOLLOWER
I20260811 00:52:58.836730 21051 consensus_queue.cc:260] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:58.836992 21051 ts_tablet_manager.cc:1428] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260811 00:52:58.839771 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.829523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:44583 (local address 127.26.99.190:46859)
0811 00:52:58.829731 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.829741 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.829788 (+ 47us) server_negotiation.cc:407] Connection header received
0811 00:52:58.830316 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.830324 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.830417 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.830594 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.831188 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.832482 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.833532 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.834104 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.834219 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.836390 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.836394 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.836395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.836406 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.838068 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.838486 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.838489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.838489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.838606 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.838806 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.838807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.838807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.839099 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.839179 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.839467 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.839592 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260811 00:52:58.839771 21237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.829359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:44583)
0811 00:52:58.829598 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.829641 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.830073 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.830604 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.830607 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.830863 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:58.831058 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.831062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.832588 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.832589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.833440 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.833443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.834225 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.834227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.834360 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.834861 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:58.834869 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:58.836252 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:58.838148 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.838155 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.838157 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.838375 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.838666 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.838667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.838667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.838756 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.839163 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:58.839170 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:58.839307 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.839394 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.839573 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":72,"threads_started":1}
I20260811 00:52:58.840418 21232 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:58.840523 21232 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:58.840709 21232 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:58.841537 20909 ts_manager.cc:194] Registered new tserver with Master: 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
I20260811 00:52:58.842711 20909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:44583
I20260811 00:52:58.843604 21232 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:52:58.850637 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.842333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46742 (local address 127.26.99.129:36525)
0811 00:52:58.842512 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.842516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.842674 (+ 158us) server_negotiation.cc:407] Connection header received
0811 00:52:58.842767 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.842769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.842785 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.842858 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.843374 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.844369 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.845482 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.845774 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.845845 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.848043 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.848051 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.848051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.848058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.849489 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.849852 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.849854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.849855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.849907 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.850080 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.850080 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.850081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.850215 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.850287 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.850449 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.850552 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260811 00:52:58.850637 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.842205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.0.0.1:46742)
0811 00:52:58.842555 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.842601 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.842687 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.842874 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.842886 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.843224 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:58.843287 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.843290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.844464 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.844466 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.845400 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.845404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.845854 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.845855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.845948 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.846492 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:58.846497 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:58.847960 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:58.849584 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.849590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.849592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.849780 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.849970 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.849971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.849971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.850030 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.850275 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:58.850281 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:58.850332 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.850406 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.850533 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":131,"threads_started":1}
I20260811 00:52:58.851025 21126 tablet_service.cc:1514] Processing DeleteTablet for tablet 468495f863064ad7a9926cd97478bebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:58 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46742
I20260811 00:52:58.851574 21255 tablet_replica.cc:330] stopping tablet replica
I20260811 00:52:58.851691 21255 raft_consensus.cc:2229] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:58.851760 21255 raft_consensus.cc:2258] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:58.852082 21255 ts_tablet_manager.cc:1905] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:58.854422 21255 ts_tablet_manager.cc:1918] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:58.854501 21255 log.cc:1196] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/468495f863064ad7a9926cd97478bebf
I20260811 00:52:58.854712 21255 ts_tablet_manager.cc:1939] T 468495f863064ad7a9926cd97478bebf P 2ad52722829f4e3d8f4efbf057de7efa: Deleting consensus metadata
I20260811 00:52:58.855240 20887 catalog_manager.cc:4841] TS 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525): tablet 468495f863064ad7a9926cd97478bebf (table test-table [id=ad16fad9f50847d4b36575f9c4c5999e]) successfully deleted
W20260811 00:52:58.921103 21249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:58.921300 21249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:58.921330 21249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:58.922511 21249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:58.922552 21249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:58.922585 21249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:58.924027 21249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:36417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=45913
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:58.924261 21249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:58.924505 21249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:58.929237 21272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:58.929231 21267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:58.929260 21249 server_base.cc:1034] running on GCE node
W20260811 00:52:58.929229 21265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:58.929620 21249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:58.929863 21249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:58.931007 21249 hybrid_clock.cc:648] HybridClock initialized: now 1786409578930998 us; error 35 us; skew 500 ppm
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:58.933485 21249 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:58.933858 21249 webserver.cc:460] Webserver started at http://127.26.99.130:45913/ using document root <none> and password file <none>
I20260811 00:52:58.934075 21249 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:58.934214 21249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:58.935456 21249 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:58.936058 21284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.936233 21249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:58.936321 21249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "f67f1c5d64874e6f82baf01c1602aae5"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "4bb053dcd3ae0879d8f0fdfb50f69b32"
server_key_iv: "d153ffb4f45aa0451f6bf2fefd4d1fdb"
server_key_version: "encryptionkey@0"
I20260811 00:52:58.936669 21249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:58.946480 21249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:58.948088 21249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:58.948210 21249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:58.948418 21249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:58.948695 21249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:58.948729 21249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.948755 21249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:58.948781 21249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:58.954149 21249 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:36417
I20260811 00:52:58.954207 21494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:36417 every 8 connection(s)
I20260811 00:52:58.954496 21249 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:52:58 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409578, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:58.962277 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 21249
I20260811 00:52:58.962527 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:33833
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=44989
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:58.963169 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.955130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:56685 (local address 127.26.99.190:46859)
0811 00:52:58.955179 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:58.955181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:58.955403 (+ 222us) server_negotiation.cc:407] Connection header received
0811 00:52:58.955870 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:58.955871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:58.955885 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:58.955935 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:58.956894 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.957405 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.958415 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.958627 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.958678 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.960630 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:58.960632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:58.960632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:58.960639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:58.961705 (+ 1066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.962088 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.962089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.962090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.962149 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:58.962461 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:58.962463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:58.962463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:58.962593 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:58.962667 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:58.962972 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 00:52:58.963072 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:52:58.963275 21502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:58.955136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:56685)
0811 00:52:58.955294 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:58.955326 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:58.955784 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:58.955996 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:58.955999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:58.956632 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:58.956816 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.956822 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.957489 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.957490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.958356 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:58.958358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:58.958684 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:58.958685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:58.958782 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:58.959192 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:58.959200 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:58.960549 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:58.961790 (+ 1241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.961797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.961798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.962019 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.962230 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:58.962231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:58.962231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:58.962358 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:58.962707 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:58.962718 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:58.962838 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 00:52:58.962926 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:52:58.963075 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260811 00:52:58.963701 21499 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:58.963804 21499 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:58.963984 21499 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:58.964429 20909 ts_manager.cc:194] Registered new tserver with Master: f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417)
I20260811 00:52:58.964891 20909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:56685
W20260811 00:52:59.044708 21503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:59.044898 21503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:59.044919 21503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:59.046057 21503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:59.046096 21503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:59.046120 21503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:59.047488 21503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:33833
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=44989
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:59.047675 21503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:59.047869 21503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:52:59.052737 21503 server_base.cc:1034] running on GCE node
W20260811 00:52:59.052714 21511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.052700 21509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.052704 21508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.053105 21503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:59.053320 21503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:59.054453 21503 hybrid_clock.cc:648] HybridClock initialized: now 1786409579054436 us; error 34 us; skew 500 ppm
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:59.056861 21503 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:59.057276 21503 webserver.cc:460] Webserver started at http://127.26.99.131:44989/ using document root <none> and password file <none>
I20260811 00:52:59.057468 21503 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:59.057528 21503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:59.058836 21503 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.059356 21529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.059530 21503 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.059634 21503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "ebb662cf92af421c845573c28d064850"
format_stamp: "Formatted at 2026-08-11 00:52:58 on dist-test-slave-xt4k"
server_key: "d68f585ebed2f778c996129a97fc5a92"
server_key_iv: "6bef51394f4c3470d7285f36b3602547"
server_key_version: "encryptionkey@0"
I20260811 00:52:59.059952 21503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:59.071817 21503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:59.073693 21503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:59.073801 21503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:59.073983 21503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:59.074226 21503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:59.074256 21503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.074276 21503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:59.074287 21503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.079504 21503 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:33833
I20260811 00:52:59.079587 21745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:33833 every 8 connection(s)
I20260811 00:52:59.079856 21503 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:52:59.088435 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 21503
I20260811 00:52:59.088589 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.080586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:60187 (local address 127.26.99.190:46859)
0811 00:52:59.080673 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.080675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.080863 (+ 188us) server_negotiation.cc:407] Connection header received
0811 00:52:59.081334 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.081335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.081347 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.081403 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:59.082392 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.082981 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.084029 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.084223 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.084277 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.086315 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:59.086317 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:59.086317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:59.086325 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:59.087429 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:59.087766 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:59.087766 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:59.087767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:59.087809 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:59.087980 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:59.087980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:59.087981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:59.088080 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:59.088124 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.088391 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.088487 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 00:52:59.088732 21748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.080554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:60187)
0811 00:52:59.080740 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.080781 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.081251 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.081463 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:59.081466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:59.082063 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:52:59.082259 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.082265 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.083074 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.083075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.083950 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.083953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.084285 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.084285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.084416 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.084900 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:52:59.084909 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:52:59.086231 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:52:59.087500 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:59.087505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:59.087507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:59.087710 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:59.087852 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:52:59.087852 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:52:59.087852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:52:59.087939 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:52:59.088120 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:52:59.088123 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:52:59.088234 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 00:52:59.088314 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:52:59.088486 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260811 00:52:59.089275 21746 heartbeater.cc:347] Connected to a master server at 127.26.99.190:46859
I20260811 00:52:59.089385 21746 heartbeater.cc:464] Registering TS with master...
I20260811 00:52:59.089600 21746 heartbeater.cc:511] Master 127.26.99.190:46859 requested a full tablet report, sending...
I20260811 00:52:59.090049 20909 ts_manager.cc:194] Registered new tserver with Master: ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
I20260811 00:52:59.090415 20909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:60187
I20260811 00:52:59.094714 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.088799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.26.99.190:46859)
0811 00:52:59.088829 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.088831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.089009 (+ 178us) server_negotiation.cc:407] Connection header received
0811 00:52:59.089073 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.089074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.089084 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.089129 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:52:59.089822 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.090316 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.091298 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.091487 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.091550 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.092653 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:52:59.092654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:52:59.092655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:52:59.092661 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:52:59.093782 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:59.094101 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:59.094102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:59.094102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:59.094152 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:52:59.094283 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:52:59.094283 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:52:59.094283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:52:59.094371 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:52:59.094540 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.094572 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.094635 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 00:52:59.095372 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:52:59.097675 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.095690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.26.99.190:46859)
0811 00:52:59.095728 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.095730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.095814 (+ 84us) server_negotiation.cc:407] Connection header received
0811 00:52:59.095869 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.095870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.095897 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.095948 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:52:59.096014 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.096485 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.097138 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.097303 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.097343 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.097459 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:52:59.097547 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:52:59.097596 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.097607 (+ 11us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.097620 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:52:59.097954 20909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:52:59.099509 20909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:52:59.101500 21126 tablet_service.cc:1467] Processing CreateTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 (DEFAULT_TABLE table=test-table [id=18e9275d8f5649dea5dd3669975dd44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:59.101711 21126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:59.103248 21051 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap starting.
I20260811 00:52:59.103669 21051 tablet_bootstrap.cc:654] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:59.104242 21051 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: No bootstrap required, opened a new log
I20260811 00:52:59.104286 21051 ts_tablet_manager.cc:1397] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:52:59.104636 21051 raft_consensus.cc:348] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.104701 21051 raft_consensus.cc:374] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:59.104728 21051 raft_consensus.cc:729] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad52722829f4e3d8f4efbf057de7efa, State: Initialized, Role: FOLLOWER
I20260811 00:52:59.104768 21051 consensus_queue.cc:260] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.104852 21051 ts_tablet_manager.cc:1428] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.105005 21752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.101247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33833 (local address 127.0.0.1:55218)
0811 00:52:59.101360 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.101370 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.101419 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.101747 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:59.101749 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:59.101751 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:59.101798 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.101799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.103040 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.103040 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.104065 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.104067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.104790 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.104792 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.104861 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.104882 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 00:52:59.104912 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 00:52:59.104952 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260811 00:52:59.105360 21755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.101389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55218 (local address 127.26.99.131:33833)
0811 00:52:59.101587 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.101592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.101601 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:52:59.101637 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.101639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.101655 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.101735 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:59.101860 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.102941 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.104137 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.104690 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.105196 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.105248 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.105269 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.105301 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
I20260811 00:52:59.105957 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.101228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:36417 (local address 127.0.0.1:60756)
0811 00:52:59.101355 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.101366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.101414 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.101876 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:59.101876 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:59.101878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:59.101906 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.101907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.102818 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.102819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.103951 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.103953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.105720 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.105721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.105788 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.105792 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:59.105845 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 00:52:59.105895 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 00:52:59.106007 21622 tablet_service.cc:1467] Processing CreateTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 (DEFAULT_TABLE table=test-table [id=18e9275d8f5649dea5dd3669975dd44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:59.106191 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.101508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60756 (local address 127.26.99.130:36417)
0811 00:52:59.101707 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.101712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.101722 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:52:59.101756 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.101758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.101773 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.101880 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:59.101945 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.102727 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.104037 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.105589 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.105652 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.105768 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.106063 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.106116 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":94,"threads_started":1}
I20260811 00:52:59.106364 21622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:59.109012 21761 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Bootstrap starting.
I20260811 00:52:59.109073 21372 tablet_service.cc:1467] Processing CreateTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 (DEFAULT_TABLE table=test-table [id=18e9275d8f5649dea5dd3669975dd44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:52:59.109436 21372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:52:59.109720 21761 tablet_bootstrap.cc:654] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:59.110255 21761 log.cc:824] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:59.111042 21761 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: No bootstrap required, opened a new log
I20260811 00:52:59.111117 21761 ts_tablet_manager.cc:1397] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:59.112852 21766 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Bootstrap starting.
I20260811 00:52:59.113034 21761 raft_consensus.cc:348] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.113168 21761 raft_consensus.cc:374] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:59.113200 21761 raft_consensus.cc:729] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebb662cf92af421c845573c28d064850, State: Initialized, Role: FOLLOWER
I20260811 00:52:59.113312 21761 consensus_queue.cc:260] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.113516 21766 tablet_bootstrap.cc:654] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Neither blocks nor log segments found. Creating new log.
I20260811 00:52:59.113566 21746 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
I20260811 00:52:59.113801 21761 ts_tablet_manager.cc:1428] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:52:59.114035 21766 log.cc:824] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:59.114780 21766 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: No bootstrap required, opened a new log
I20260811 00:52:59.114837 21766 ts_tablet_manager.cc:1397] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:52:59.116117 21766 raft_consensus.cc:348] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.116241 21766 raft_consensus.cc:374] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:52:59.116262 21766 raft_consensus.cc:729] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67f1c5d64874e6f82baf01c1602aae5, State: Initialized, Role: FOLLOWER
I20260811 00:52:59.116380 21766 consensus_queue.cc:260] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.116631 21766 ts_tablet_manager.cc:1428] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:52:59.116657 21499 heartbeater.cc:503] Master 127.26.99.190:46859 was elected leader, sending a full tablet report...
I20260811 00:52:59.154855 21776 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:52:59.154997 21776 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.155395 21776 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebb662cf92af421c845573c28d064850 (127.26.99.131:33833), 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
I20260811 00:52:59.158416 21755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.155695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:44807 (local address 127.26.99.131:33833)
0811 00:52:59.155737 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.155738 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.155896 (+ 158us) server_negotiation.cc:407] Connection header received
0811 00:52:59.155943 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.155944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.155954 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.156007 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:59.156143 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.156646 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.157674 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.158067 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.158134 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.158143 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.158287 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.158335 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:52:59.158460 21502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.155599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.26.99.130:50699)
0811 00:52:59.155657 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.155668 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.155720 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.155920 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:59.155921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:59.155923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:59.156001 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.156003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.156731 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.156732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.157604 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.157607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.158192 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.158193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.158261 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.158265 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:52:59.158335 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 00:52:59.158374 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":35}
I20260811 00:52:59.158453 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.155681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:50699 (local address 127.26.99.129:36525)
0811 00:52:59.155728 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.155730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.155760 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:52:59.155792 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.155793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.155823 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.155888 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:52:59.156076 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.156655 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.157693 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.158097 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.158187 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.158270 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.158344 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.158383 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:52:59.158532 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.155620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33833 (local address 127.26.99.130:44807)
0811 00:52:59.155809 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.155819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.155879 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.156013 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:52:59.156014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:52:59.156015 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:52:59.156080 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.156082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.156717 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.156718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.157588 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:52:59.157591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.158149 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.158150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:52:59.158218 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.158221 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:52:59.158273 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:52:59.158355 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":47,"thread_start_us":131,"threads_started":1}
I20260811 00:52:59.158776 21162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3ca3a2dfa2d4b6ebf0a58a8d4927662" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad52722829f4e3d8f4efbf057de7efa" is_pre_election: true
I20260811 00:52:59.158825 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3ca3a2dfa2d4b6ebf0a58a8d4927662" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb662cf92af421c845573c28d064850" is_pre_election: true
I20260811 00:52:59.158941 21162 raft_consensus.cc:2454] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 0.
I20260811 00:52:59.158983 21660 raft_consensus.cc:2454] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 0.
I20260811 00:52:59.159226 21285 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5; no voters:
I20260811 00:52:59.159348 21776 raft_consensus.cc:2781] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:52:59.159423 21776 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:52:59.159447 21776 raft_consensus.cc:3037] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:59.160180 21776 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.160313 21776 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 election: Requested vote from peers ebb662cf92af421c845573c28d064850 (127.26.99.131:33833), 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525)
I20260811 00:52:59.160507 21162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3ca3a2dfa2d4b6ebf0a58a8d4927662" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ad52722829f4e3d8f4efbf057de7efa"
I20260811 00:52:59.160514 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3ca3a2dfa2d4b6ebf0a58a8d4927662" candidate_uuid: "f67f1c5d64874e6f82baf01c1602aae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebb662cf92af421c845573c28d064850"
I20260811 00:52:59.160591 21162 raft_consensus.cc:3037] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:59.160590 21660 raft_consensus.cc:3037] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:52:59.161234 21162 raft_consensus.cc:2454] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 1.
I20260811 00:52:59.161309 21660 raft_consensus.cc:2454] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f67f1c5d64874e6f82baf01c1602aae5 in term 1.
I20260811 00:52:59.161437 21287 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa, f67f1c5d64874e6f82baf01c1602aae5; no voters:
I20260811 00:52:59.161531 21776 raft_consensus.cc:2781] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:52:59.161702 21776 raft_consensus.cc:686] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 1 LEADER]: Becoming Leader. State: Replica: f67f1c5d64874e6f82baf01c1602aae5, State: Running, Role: LEADER
I20260811 00:52:59.161798 21776 consensus_queue.cc:237] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.162714 20908 catalog_manager.cc:5495] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "f67f1c5d64874e6f82baf01c1602aae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } health_report { overall_health: UNKNOWN } } }
I20260811 00:52:59.179277 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.177255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60772 (local address 127.26.99.130:36417)
0811 00:52:59.177304 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:52:59.177306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:52:59.177316 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:52:59.177396 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:52:59.177397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:52:59.177413 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:52:59.177464 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:52:59.177566 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.178036 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.178675 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:52:59.178847 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:52:59.178888 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:52:59.178989 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:52:59.179093 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:52:59.179148 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:52:59.179161 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 00:52:59.179177 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:52:59.181078 21660 raft_consensus.cc:1261] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Refusing update from remote peer f67f1c5d64874e6f82baf01c1602aae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:59.181090 21162 raft_consensus.cc:1261] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Refusing update from remote peer f67f1c5d64874e6f82baf01c1602aae5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:52:59.181407 21779 consensus_queue.cc:1035] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:59.181542 21776 consensus_queue.cc:1035] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:52:59.184132 21781 mvcc.cc:205] Tried to move back new op lower bound from 7317133636323090432 to 7317133636247388160. Current Snapshot: MvccSnapshot[applied={T|T < 7317133636323090432}]
I20260811 00:52:59.184661 21784 mvcc.cc:205] Tried to move back new op lower bound from 7317133636323090432 to 7317133636247388160. Current Snapshot: MvccSnapshot[applied={T|T < 7317133636323090432}]
I20260811 00:52:59.186576 20908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:59.186662 20908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:52:59.187366 20908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Sending DeleteTablet for 3 replicas of tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:52:59.187716 21126 tablet_service.cc:1514] Processing DeleteTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:59 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46742
I20260811 00:52:59.187707 21622 tablet_service.cc:1514] Processing DeleteTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:59 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55218
I20260811 00:52:59.187805 21255 tablet_replica.cc:330] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: stopping tablet replica
I20260811 00:52:59.187848 21255 raft_consensus.cc:2229] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:59.187850 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 20978
I20260811 00:52:59.187899 21255 raft_consensus.cc:2258] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:59.187966 21372 tablet_service.cc:1514] Processing DeleteTablet for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:52:59 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:60756
I20260811 00:52:59.211421 21803 tablet_replica.cc:330] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: stopping tablet replica
I20260811 00:52:59.211597 21803 raft_consensus.cc:2229] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:52:59.211717 21803 raft_consensus.cc:2258] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:59.216751 21803 ts_tablet_manager.cc:1905] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:59.218333 21803 ts_tablet_manager.cc:1918] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:59.218407 21803 log.cc:1196] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:52:59.218662 21803 ts_tablet_manager.cc:1939] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P ebb662cf92af421c845573c28d064850: Deleting consensus metadata
I20260811 00:52:59.219118 20885 catalog_manager.cc:4841] TS ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 (table test-table [id=18e9275d8f5649dea5dd3669975dd44f]) successfully deleted
I20260811 00:52:59.232486 21804 tablet_replica.cc:330] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: stopping tablet replica
I20260811 00:52:59.232651 21804 raft_consensus.cc:2229] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:52:59.232816 21804 raft_consensus.cc:2258] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:52:59.234586 21804 ts_tablet_manager.cc:1905] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:52:59.236382 21804 ts_tablet_manager.cc:1918] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:52:59.236466 21804 log.cc:1196] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:52:59.236755 21804 ts_tablet_manager.cc:1939] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P f67f1c5d64874e6f82baf01c1602aae5: Deleting consensus metadata
I20260811 00:52:59.237262 20890 catalog_manager.cc:4841] TS f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662 (table test-table [id=18e9275d8f5649dea5dd3669975dd44f]) successfully deleted
W20260811 00:52:59.239404 20887 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:36525 (error 108)
I20260811 00:52:59.239518 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 21249
I20260811 00:52:59.242628 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.242477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:36525 (local address 127.0.0.1:46750)
0811 00:52:59.242530 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.242585 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 00:52:59.242784 20887 catalog_manager.cc:4584] TS 2ad52722829f4e3d8f4efbf057de7efa (127.26.99.129:36525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3ca3a2dfa2d4b6ebf0a58a8d4927662: Network error: Client connection negotiation failed: client connection to 127.26.99.129:36525: connect: Connection refused (error 111)
I20260811 00:52:59.251678 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 21503
I20260811 00:52:59.261861 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 20855
I20260811 00:52:59.276788 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--webserver_interface=127.26.99.190
--webserver_port=46293
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:46859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:59.359203 21806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:59.359390 21806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:59.359411 21806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:59.360481 21806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:52:59.360512 21806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:59.360525 21806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:59.360535 21806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:52:59.360553 21806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:52:59.361958 21806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:46859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:46859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=46293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:59.362141 21806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:59.362305 21806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:52:59.367084 21806 server_base.cc:1034] running on GCE node
W20260811 00:52:59.367053 21811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.367162 21820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.367096 21814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.367558 21806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:59.367831 21806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:59.368968 21806 hybrid_clock.cc:648] HybridClock initialized: now 1786409579368953 us; error 27 us; skew 500 ppm
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:59.371316 21806 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:52:59.371731 21806 webserver.cc:460] Webserver started at http://127.26.99.190:46293/ using document root <none> and password file <none>
I20260811 00:52:59.371920 21806 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:59.371968 21806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:59.373261 21806 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.373869 21832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.374014 21806 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:59.374106 21806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "419fad4511c74f31938c61b521e6a532"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "597b94e76abe35d7840e235c2e3a541e"
server_key_iv: "7c4ed94c3695571f31a63a72353c05d2"
server_key_version: "encryptionkey@0"
I20260811 00:52:59.374408 21806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:59.382053 21806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:59.383764 21806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:59.383886 21806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:59.387661 21806 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:46859
I20260811 00:52:59.387694 21921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:46859 every 8 connection(s)
I20260811 00:52:59.388029 21806 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:52:59.389529 21922 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:52:59.390184 21922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap starting.
I20260811 00:52:59.391858 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 21806
I20260811 00:52:59.392097 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:36525
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=42541
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:59.398825 21922 log.cc:824] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:59.401109 21922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:52:59.401378 21922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532: Bootstrap complete.
I20260811 00:52:59.403481 21922 raft_consensus.cc:348] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:59.403700 21922 raft_consensus.cc:729] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Initialized, Role: FOLLOWER
I20260811 00:52:59.403844 21922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:59.403904 21922 raft_consensus.cc:388] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:52:59.403940 21922 raft_consensus.cc:482] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:52:59.403988 21922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:52:59.404986 21922 raft_consensus.cc:504] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:59.405078 21922 leader_election.cc:302] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 419fad4511c74f31938c61b521e6a532; no voters:
I20260811 00:52:59.405236 21922 leader_election.cc:288] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 00:52:59.405280 21927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 00:52:59.405391 21927 raft_consensus.cc:686] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [term 3 LEADER]: Becoming Leader. State: Replica: 419fad4511c74f31938c61b521e6a532, State: Running, Role: LEADER
I20260811 00:52:59.405488 21927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } }
I20260811 00:52:59.405495 21922 sys_catalog.cc:564] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:52:59.405761 21929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:59.405757 21931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 419fad4511c74f31938c61b521e6a532. Latest consensus state: current_term: 3 leader_uuid: "419fad4511c74f31938c61b521e6a532" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "419fad4511c74f31938c61b521e6a532" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 46859 } } }
I20260811 00:52:59.405841 21929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:59.405845 21931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 419fad4511c74f31938c61b521e6a532 [sys.catalog]: This master's current role is: LEADER
I20260811 00:52:59.406036 21933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:52:59.406807 21933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:52:59.406908 21933 catalog_manager.cc:1259] Loaded cluster ID: e19ebff21c474d9ab274488e05af99b7
I20260811 00:52:59.406939 21933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 00:52:59.407270 21933 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f43bfce19ad google::LogMessage::Fail() at ??:0
@ 0x7f43bfce488a google::LogMessage::SendToLog() at ??:0
@ 0x7f43bfce14de google::LogMessage::Flush() at ??:0
@ 0x7f43bfce2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f43c7c020f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f43c7c0b8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f43c1baf0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f43c1ba4954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f43c2a086db start_thread at ??:0
@ 0x7f43be7df61f clone at ??:0
W20260811 00:52:59.487195 21925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:59.487380 21925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:59.487401 21925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:59.488554 21925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:59.488592 21925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:59.488617 21925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:52:59.490036 21925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:36525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=42541
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:59.490236 21925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:59.490448 21925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:59.495307 22003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.495352 21998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.495352 22000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.495642 21925 server_base.cc:1034] running on GCE node
I20260811 00:52:59.495859 21925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:59.496091 21925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:59.497228 21925 hybrid_clock.cc:648] HybridClock initialized: now 1786409579497215 us; error 30 us; skew 500 ppm
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:59.499809 21925 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:52:59.500259 21925 webserver.cc:460] Webserver started at http://127.26.99.129:42541/ using document root <none> and password file <none>
I20260811 00:52:59.500509 21925 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:59.500571 21925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:59.501943 21925 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.502628 22016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.502782 21925 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.502868 21925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "2ad52722829f4e3d8f4efbf057de7efa"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "7d8c6774c7051d1475b5484b26747c49"
server_key_iv: "c0b11b022d19d0e8835ec52bd0f1a97a"
server_key_version: "encryptionkey@0"
I20260811 00:52:59.503176 21925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:59.509385 21925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:59.511246 21925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:59.511371 21925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:59.511566 21925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:59.511956 22030 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:52:59.513775 21925 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:52:59.513818 21925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:52:59.513847 21925 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:52:59.514460 21925 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:52:59.514493 21925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:52:59.514587 22030 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap starting.
I20260811 00:52:59.521073 21925 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:36525
I20260811 00:52:59.521178 22235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:36525 every 8 connection(s)
I20260811 00:52:59.521504 21925 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:52:59.525631 22030 log.cc:824] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Log is configured to *not* fsync() on all Append() calls
I20260811 00:52:59.528294 22030 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:52:59.528625 22030 tablet_bootstrap.cc:492] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Bootstrap complete.
I20260811 00:52:59.528997 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 21925
I20260811 00:52:59.529240 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:36417
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=45913
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:52:59.529774 22030 ts_tablet_manager.cc:1397] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260811 00:52:59.531198 22030 raft_consensus.cc:348] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.531530 22030 raft_consensus.cc:729] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ad52722829f4e3d8f4efbf057de7efa, State: Initialized, Role: FOLLOWER
I20260811 00:52:59.531715 22030 consensus_queue.cc:260] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:52:59.532011 22030 ts_tablet_manager.cc:1428] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260811 00:52:59.596025 22242 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:52:59.522150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:39523)
0811 00:52:59.522313 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.522356 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:52:59.522813 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:52:59.595851 (+ 73038us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
W20260811 00:52:59.596314 22240 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:46859 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:46859: Client connection negotiation failed: client connection to 127.26.99.190:46859: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:52:59.596764 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.596658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:54873)
0811 00:52:59.596704 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.596745 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 00:52:59.597069 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.596995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:35463)
0811 00:52:59.597032 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.597054 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 00:52:59.597175 22240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:52:59.616014 22245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:59.616215 22245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:59.616240 22245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:59.617374 22245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:59.617421 22245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:59.617446 22245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:52:59.618880 22245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:36417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=45913
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:59.619072 22245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:59.619252 22245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:59.624066 22256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.624070 22254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.624305 22245 server_base.cc:1034] running on GCE node
W20260811 00:52:59.624394 22260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.624589 22245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:59.624788 22245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:59.625926 22245 hybrid_clock.cc:648] HybridClock initialized: now 1786409579625912 us; error 34 us; skew 500 ppm
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:59.628574 22245 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:52:59.629005 22245 webserver.cc:460] Webserver started at http://127.26.99.130:45913/ using document root <none> and password file <none>
I20260811 00:52:59.629222 22245 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:59.629311 22245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:59.630728 22245 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:52:59.631322 22275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.631484 22245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.631567 22245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "f67f1c5d64874e6f82baf01c1602aae5"
format_stamp: "Formatted at 2026-08-11 00:52:57 on dist-test-slave-xt4k"
server_key: "4bb053dcd3ae0879d8f0fdfb50f69b32"
server_key_iv: "d153ffb4f45aa0451f6bf2fefd4d1fdb"
server_key_version: "encryptionkey@0"
I20260811 00:52:59.631896 22245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:59.656457 22245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:59.658318 22245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:59.658476 22245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:59.658699 22245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:59.658995 22245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:59.659029 22245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.659058 22245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:59.659082 22245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.664762 22245 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:36417
I20260811 00:52:59.664819 22464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:36417 every 8 connection(s)
I20260811 00:52:59.665131 22245 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:52:59.666149 22471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.665725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:43683)
0811 00:52:59.665911 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.666004 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":79,"threads_started":1}
W20260811 00:52:59.666541 22466 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:46859 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:46859: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
I20260811 00:52:59.666853 22471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.666715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:46097)
0811 00:52:59.666811 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.666834 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 00:52:59.667124 22471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.667045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:49621)
0811 00:52:59.667081 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.667103 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 00:52:59.667214 22466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:52:59.677369 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 22245
I20260811 00:52:59.677661 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:33833
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:46859
--webserver_port=44989
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:35267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:52:59.765355 22472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:52:59.765547 22472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:52:59.765569 22472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:52:59.766673 22472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:52:59.766710 22472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:52:59.766734 22472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:52:59.768222 22472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:35267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:33833
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=44989
--tserver_master_addrs=127.26.99.190:46859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:52:59.768469 22472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:52:59.768669 22472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:52:59.773500 22484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.773542 22485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:52:59.773550 22488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:52:59.773689 22472 server_base.cc:1034] running on GCE node
I20260811 00:52:59.774122 22472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:52:59.774334 22472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:52:59.775487 22472 hybrid_clock.cc:648] HybridClock initialized: now 1786409579775471 us; error 32 us; skew 500 ppm
Aug 11 00:52:59 dist-test-slave-xt4k krb5kdc[19886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:52:59.777848 22472 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:52:59.778254 22472 webserver.cc:460] Webserver started at http://127.26.99.131:44989/ using document root <none> and password file <none>
I20260811 00:52:59.778455 22472 fs_manager.cc:359] Metadata directory not provided
I20260811 00:52:59.778503 22472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:52:59.779716 22472 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:52:59.780205 22499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.780373 22472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:52:59.780462 22472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "ebb662cf92af421c845573c28d064850"
format_stamp: "Formatted at 2026-08-11 00:52:58 on dist-test-slave-xt4k"
server_key: "d68f585ebed2f778c996129a97fc5a92"
server_key_iv: "6bef51394f4c3470d7285f36b3602547"
server_key_version: "encryptionkey@0"
I20260811 00:52:59.780771 22472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:52:59.806479 22472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:52:59.808571 22472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:52:59.808702 22472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:52:59.808943 22472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:52:59.809247 22472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:52:59.809281 22472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.809303 22472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:52:59.809326 22472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:52:59.814755 22472 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:33833
I20260811 00:52:59.814816 22690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:33833 every 8 connection(s)
I20260811 00:52:59.815130 22472 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:52:59.816133 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.815747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:35893)
0811 00:52:59.815893 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.815984 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
W20260811 00:52:59.816579 22691 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:46859 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:46859: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
I20260811 00:52:59.816833 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.816751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:46027)
0811 00:52:59.816789 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.816816 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 00:52:59.817072 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:52:59.817006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:58107)
0811 00:52:59.817039 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 00:52:59.817058 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 00:52:59.817175 22691 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:52:59.825276 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 22472
I20260811 00:53:00.597805 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.597538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:33851)
0811 00:53:00.597679 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:00.597737 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260811 00:53:00.667735 22698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.667507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:54971)
0811 00:53:00.667637 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:00.667671 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":57,"threads_started":1}
I20260811 00:53:00.817670 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.817485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:45073)
0811 00:53:00.817593 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:00.817626 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
I20260811 00:53:00.884155 22702 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:00.884284 22702 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:53:00.884701 22702 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417), ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
Aug 11 00:53:00 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.131@KRBTEST.COM
Aug 11 00:53:00 dist-test-slave-xt4k krb5kdc[19886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409579, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.130@KRBTEST.COM
I20260811 00:53:00.895288 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.884871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:36417 (local address 127.26.99.129:58993)
0811 00:53:00.884937 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:00.884947 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:00.885002 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:00.886035 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:00.886038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:00.886371 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:00.886567 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:00.886572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.887637 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.887638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:00.888471 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:00.888474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.889028 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.889029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:00.889144 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:00.889671 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:00.889679 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:00.891523 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:00.893667 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:00.893678 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:00.893680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:00.893899 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:00.894179 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:00.894180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:00.894283 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:00.894737 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:00.894742 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:00.894874 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 00:53:00.894998 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 00:53:00.895174 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":50}
I20260811 00:53:00.895323 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.884987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:54475 (local address 127.26.99.131:33833)
0811 00:53:00.885176 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:00.885184 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:00.885212 (+ 28us) server_negotiation.cc:407] Connection header received
0811 00:53:00.885792 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:00.885795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:00.885849 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:00.886002 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:00.886682 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.887538 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.888553 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.888947 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.889049 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:00.891269 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:00.891273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:00.891273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:00.891283 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:00.893571 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894204 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:00.894207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:00.894207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:00.894294 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894466 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:00.894467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:00.894468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:00.894767 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:00.894830 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:00.895058 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 00:53:00.895203 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":53,"threads_started":1}
I20260811 00:53:00.895326 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.884982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:58993 (local address 127.26.99.130:36417)
0811 00:53:00.885162 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:00.885175 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:00.885211 (+ 36us) server_negotiation.cc:407] Connection header received
0811 00:53:00.885787 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:00.885790 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:00.885849 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:00.886002 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:00.886688 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.887538 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.888544 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.888948 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.889048 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:00.891641 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:00.891645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:00.891645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:00.891658 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:00.893571 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894008 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:00.894011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:00.894011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:00.894108 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894346 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:00.894346 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:00.894347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:00.894669 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:00.894758 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:00.895058 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 00:53:00.895203 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":55,"threads_started":1}
I20260811 00:53:00.895344 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:00.884892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:33833 (local address 127.26.99.129:54475)
0811 00:53:00.884999 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:00.885006 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:00.885043 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:00.886130 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:00.886130 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:00.886372 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:00.886567 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:00.886572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.887631 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.887631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:00.888479 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:00.888481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:00.889031 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:00.889032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:00.889145 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:00.889712 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:00.889716 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:00.891167 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:00.893971 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:00.893972 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:00.893972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:00.894114 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:00.894359 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:00.894360 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:00.894360 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:00.894413 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:00.894823 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:00.894823 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:00.894874 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 00:53:00.894998 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 00:53:00.895236 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":127,"thread_start_us":52,"threads_started":1}
W20260811 00:53:00.896447 22017 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
W20260811 00:53:00.896538 22021 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:53:00.896601 22021 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa; no voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5
I20260811 00:53:00.896711 22702 raft_consensus.cc:2726] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:53:01.598441 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:01.598204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:35353)
0811 00:53:01.598347 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:01.598384 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":63,"threads_started":1}
I20260811 00:53:01.668308 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:01.668127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:39677)
0811 00:53:01.668237 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:01.668271 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260811 00:53:01.818252 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:01.818061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:43631)
0811 00:53:01.818182 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:01.818216 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":72,"threads_started":1}
I20260811 00:53:02.599105 22715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:02.598874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:57619)
0811 00:53:02.599019 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:02.599057 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260811 00:53:02.658042 22718 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:02.658138 22718 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:53:02.658317 22718 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417), ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
W20260811 00:53:02.658712 22017 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
W20260811 00:53:02.658807 22021 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:53:02.658875 22021 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa; no voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5
I20260811 00:53:02.658947 22718 raft_consensus.cc:2726] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:53:02.668953 22719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:02.668738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:34475)
0811 00:53:02.668876 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:02.668913 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260811 00:53:02.818872 22720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:02.818663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:59319)
0811 00:53:02.818797 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:02.818832 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260811 00:53:03.599826 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:03.599555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:57899)
0811 00:53:03.599733 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:03.599778 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
I20260811 00:53:03.669656 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:03.669430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:33241)
0811 00:53:03.669568 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:03.669612 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260811 00:53:03.819622 22725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:03.819397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:49345)
0811 00:53:03.819530 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:03.819579 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 00:53:04.600554 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:04.600321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:42681)
0811 00:53:04.600469 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:04.600509 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":93,"threads_started":1}
I20260811 00:53:04.670347 22728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:04.670101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:45289)
0811 00:53:04.670262 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:04.670300 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260811 00:53:04.820362 22729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:04.820106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:55191)
0811 00:53:04.820255 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:04.820294 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260811 00:53:05.313000 22730 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:05.313103 22730 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:53:05.313247 22730 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417), ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
W20260811 00:53:05.313627 22017 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
W20260811 00:53:05.313714 22021 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:53:05.313758 22021 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa; no voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5
I20260811 00:53:05.313817 22730 raft_consensus.cc:2726] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:53:05.601187 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:05.600963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:42813)
0811 00:53:05.601101 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:05.601137 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260811 00:53:05.671063 22737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:05.670791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:57975)
0811 00:53:05.670946 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:05.670996 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 00:53:05.821082 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:05.820878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:58603)
0811 00:53:05.821007 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:05.821040 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260811 00:53:06.601879 22739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:06.601618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:38819)
0811 00:53:06.601786 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:06.601830 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":68,"threads_started":1}
I20260811 00:53:06.671772 22740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:06.671539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:59227)
0811 00:53:06.671674 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:06.671721 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
I20260811 00:53:06.821738 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:06.821533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:38445)
0811 00:53:06.821646 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:06.821680 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260811 00:53:07.602596 22742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:07.602350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:60141)
0811 00:53:07.602508 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:07.602546 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260811 00:53:07.672542 22743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:07.672289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:48165)
0811 00:53:07.672452 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:07.672491 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260811 00:53:07.822410 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:07.822170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:45387)
0811 00:53:07.822314 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:07.822356 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260811 00:53:08.294100 22749 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:08.294207 22749 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:53:08.294399 22749 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417), ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
W20260811 00:53:08.294798 22017 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
W20260811 00:53:08.294884 22021 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:53:08.294945 22021 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa; no voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5
I20260811 00:53:08.295030 22749 raft_consensus.cc:2726] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:53:08.603269 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:08.603054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:59921)
0811 00:53:08.603180 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:08.603221 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260811 00:53:08.673343 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:08.673066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:39901)
0811 00:53:08.673225 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:08.673270 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":68,"threads_started":1}
I20260811 00:53:08.823066 22752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:08.822846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:46083)
0811 00:53:08.822979 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:08.823024 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
I20260811 00:53:09.604053 22756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:09.603799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:44757)
0811 00:53:09.603963 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:09.604003 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260811 00:53:09.674043 22757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:09.673785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:60515)
0811 00:53:09.673949 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:09.673994 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260811 00:53:09.823729 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:09.823476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:43839)
0811 00:53:09.823641 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:09.823679 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260811 00:53:10.604725 22759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:10.604503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:47019)
0811 00:53:10.604640 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:10.604676 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260811 00:53:10.674785 22760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:10.674541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:44145)
0811 00:53:10.674691 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:10.674737 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260811 00:53:10.824419 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:10.824177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:49833)
0811 00:53:10.824302 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:10.824369 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260811 00:53:11.605348 22765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:11.605156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:49007)
0811 00:53:11.605265 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:11.605302 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260811 00:53:11.675485 22767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:11.675251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:56907)
0811 00:53:11.675392 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:11.675438 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260811 00:53:11.824978 22769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:11.824792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:34759)
0811 00:53:11.824905 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:11.824938 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260811 00:53:12.606029 22770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:12.605784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:60725)
0811 00:53:12.605942 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:12.605978 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260811 00:53:12.676138 22771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:12.675925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:59263)
0811 00:53:12.676054 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:12.676089 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260811 00:53:12.825618 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:12.825406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:48407)
0811 00:53:12.825520 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:12.825571 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260811 00:53:13.293227 22778 raft_consensus.cc:482] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:13.293331 22778 raft_consensus.cc:504] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f67f1c5d64874e6f82baf01c1602aae5" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 36417 } } peers { permanent_uuid: "ebb662cf92af421c845573c28d064850" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 33833 } } peers { permanent_uuid: "2ad52722829f4e3d8f4efbf057de7efa" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 36525 } }
I20260811 00:53:13.293496 22778 leader_election.cc:288] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417), ebb662cf92af421c845573c28d064850 (127.26.99.131:33833)
W20260811 00:53:13.293869 22017 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ebb662cf92af421c845573c28d064850 (127.26.99.131:33833): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
W20260811 00:53:13.293959 22021 leader_election.cc:341] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f67f1c5d64874e6f82baf01c1602aae5 (127.26.99.130:36417): Not found: Tablet not found: b3ca3a2dfa2d4b6ebf0a58a8d4927662
I20260811 00:53:13.294015 22021 leader_election.cc:302] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ad52722829f4e3d8f4efbf057de7efa; no voters: ebb662cf92af421c845573c28d064850, f67f1c5d64874e6f82baf01c1602aae5
I20260811 00:53:13.294098 22778 raft_consensus.cc:2726] T b3ca3a2dfa2d4b6ebf0a58a8d4927662 P 2ad52722829f4e3d8f4efbf057de7efa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:53:13.606642 22781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:13.606435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:40499)
0811 00:53:13.606549 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:13.606582 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260811 00:53:13.676832 22782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:13.676603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:35853)
0811 00:53:13.676743 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:13.676787 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260811 00:53:13.826360 22783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:13.826126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:38621)
0811 00:53:13.826268 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:13.826304 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":63,"threads_started":1}
I20260811 00:53:14.607398 22786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:14.607163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.129:42853)
0811 00:53:14.607310 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:14.607352 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
I20260811 00:53:14.677567 22787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:14.677325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.130:54529)
0811 00:53:14.677479 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:14.677519 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":63,"threads_started":1}
I20260811 00:53:14.827092 22789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:14.826862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:46859 (local address 127.26.99.131:52649)
0811 00:53:14.827003 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:14.827039 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:46859: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260811 00:53:14.829200 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 21925
I20260811 00:53:14.847430 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 22245
I20260811 00:53:14.860538 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 22472
2026-08-11T00:53:14Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18596 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:53:14 dist-test-slave-xt4k krb5kdc[22793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:53:14 dist-test-slave-xt4k krb5kdc[22793](info): set up 2 sockets
Aug 11 00:53:14 dist-test-slave-xt4k krb5kdc[22793](info): commencing operation
krb5kdc: starting...
W20260811 00:53:16.070262 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:53:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:53:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:53:16.188517 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:16.270320 22818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:16.270526 22818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:16.270548 22818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:16.271637 22818 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:53:16.271669 22818 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:53:16.271680 22818 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:53:16.271690 22818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:53:16.271703 22818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:16.271821 22818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:16.271847 22818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:53:16.271863 22818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:53:16.273810 22818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:16.274035 22818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:16.274227 22818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:16.278925 22828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:16.278957 22831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.279143 22818 server_base.cc:1034] running on GCE node
W20260811 00:53:16.278898 22827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.279412 22818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:16.279693 22818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:16.280846 22818 hybrid_clock.cc:648] HybridClock initialized: now 1786409596280828 us; error 28 us; skew 500 ppm
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:16.283375 22818 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:53:16.283812 22818 webserver.cc:460] Webserver started at http://127.26.99.190:43867/ using document root <none> and password file <none>
I20260811 00:53:16.284045 22818 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:16.284096 22818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:16.284224 22818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:53:16.285318 22818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "d2fb3ecc406b4a20a987b01d2307ccd7"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "1447d0f70058831c0c5f098a40fb4122"
server_key_iv: "f0aee740aafcc1a2d852af8fc260a316"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.285642 22818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "d2fb3ecc406b4a20a987b01d2307ccd7"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "1447d0f70058831c0c5f098a40fb4122"
server_key_iv: "f0aee740aafcc1a2d852af8fc260a316"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.286881 22818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:53:16.287564 22843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.287731 22818 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:53:16.287817 22818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "d2fb3ecc406b4a20a987b01d2307ccd7"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "1447d0f70058831c0c5f098a40fb4122"
server_key_iv: "f0aee740aafcc1a2d852af8fc260a316"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.287884 22818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:16.309906 22818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:16.312142 22818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:16.312325 22818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:16.316270 22818 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37143
I20260811 00:53:16.316315 22934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37143 every 8 connection(s)
I20260811 00:53:16.316664 22818 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:53:16.317642 22935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:16.320004 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap starting.
I20260811 00:53:16.320642 22935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:16.320932 22935 log.cc:824] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:16.321587 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: No bootstrap required, opened a new log
I20260811 00:53:16.323364 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 22818
I20260811 00:53:16.323479 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:53:16.323331 22935 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:16.323516 22935 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:16.323551 22935 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Initialized, Role: FOLLOWER
I20260811 00:53:16.323696 27022 external_mini_cluster.cc:1428] Setting key 3e6dfadd2a72a936267523a06ad16b08
I20260811 00:53:16.323709 22935 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:16.323791 22935 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:53:16.323828 22935 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:53:16.323874 22935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:16.324832 22935 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:16.324935 22935 leader_election.cc:302] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2fb3ecc406b4a20a987b01d2307ccd7; no voters:
I20260811 00:53:16.325083 22935 leader_election.cc:288] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:53:16.325122 22944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:53:16.325228 22944 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 LEADER]: Becoming Leader. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Running, Role: LEADER
I20260811 00:53:16.325363 22935 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:53:16.325371 22944 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:16.325740 22944 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2fb3ecc406b4a20a987b01d2307ccd7. Latest consensus state: current_term: 1 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:16.325901 22944 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:16.326375 22957 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:53:16.326934 22957 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:53:16.327095 22945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:16.327257 22945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:16.328688 22957 catalog_manager.cc:1347] Generated new cluster ID: b9dacecea0ce474291ed54122884ea01
I20260811 00:53:16.328739 22957 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:16.334867 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.324192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.26.99.190:37143)
0811 00:53:16.324393 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.324403 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.324436 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:53:16.324539 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.324545 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.324587 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.324701 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:16.325388 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.326815 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.327830 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.328452 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.328555 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.331118 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:16.331122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:16.331123 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:16.331134 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:16.333086 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.333430 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.333434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.333434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.333548 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.333714 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.333715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.333715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.333989 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:16.334132 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.334532 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.334660 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260811 00:53:16.337194 22957 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:53:16.337906 22957 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:53:16.342626 22957 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Generated new TSK 0
I20260811 00:53:16.342790 22957 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:53:16.368731 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:16.451450 22992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:16.451653 22992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:16.451674 22992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:16.452832 22992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:16.452872 22992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:16.452896 22992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:53:16.454313 22992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:16.454538 22992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:16.454751 22992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:16.459700 23005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:16.459723 23010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:16.459723 23004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.459990 22992 server_base.cc:1034] running on GCE node
I20260811 00:53:16.460186 22992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:16.460438 22992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:16.461598 22992 hybrid_clock.cc:648] HybridClock initialized: now 1786409596461586 us; error 25 us; skew 500 ppm
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:16.464120 22992 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:53:16.464562 22992 webserver.cc:460] Webserver started at http://127.26.99.129:44997/ using document root <none> and password file <none>
I20260811 00:53:16.464771 22992 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:16.464818 22992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:16.464948 22992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:53:16.465961 22992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "86c3359df6254c6fbc9e0a0dece77dea"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "93b11b7db0c8450093ba5af8a29bb097"
server_key_iv: "6770ed41ac89c67f52c26bceb9ad89a1"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.466292 22992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "86c3359df6254c6fbc9e0a0dece77dea"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "93b11b7db0c8450093ba5af8a29bb097"
server_key_iv: "6770ed41ac89c67f52c26bceb9ad89a1"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.467530 22992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:53:16.468204 23020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.468393 22992 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:53:16.468482 22992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "86c3359df6254c6fbc9e0a0dece77dea"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "93b11b7db0c8450093ba5af8a29bb097"
server_key_iv: "6770ed41ac89c67f52c26bceb9ad89a1"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.468549 22992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:16.484231 22992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:16.486124 22992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:16.486258 22992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:16.486478 22992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:16.486776 22992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:16.486810 22992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.486840 22992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:16.486862 22992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.492758 22992 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:44629
I20260811 00:53:16.492810 23224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:44629 every 8 connection(s)
I20260811 00:53:16.493112 22992 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:53:16.494243 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 22992
I20260811 00:53:16.494372 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:53:16.494585 27022 external_mini_cluster.cc:1428] Setting key b99b31579ae26f2ab99070d288b19abd
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:16.502933 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.493772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:33859 (local address 127.26.99.190:37143)
0811 00:53:16.493847 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.493849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.494015 (+ 166us) server_negotiation.cc:407] Connection header received
0811 00:53:16.494702 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.494703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.494716 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.494780 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:16.496005 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.496590 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.497722 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.498018 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.498095 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.500261 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:16.500262 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:16.500263 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:16.500269 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:16.501547 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.502010 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.502011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.502011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.502067 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.502315 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.502315 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.502315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.502430 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:16.502475 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.502802 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.502865 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 00:53:16.503189 23229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.493741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:33859)
0811 00:53:16.493895 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.493932 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.494561 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.494856 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.494860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.495626 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:16.495892 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.495898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.496683 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.496684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.497631 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.497634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.498122 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.498124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.498238 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.498753 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:16.498762 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:16.500170 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:16.501625 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.501631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.501634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.501925 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.502124 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.502124 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.502125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.502258 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.502485 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:16.502491 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:16.502656 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.502778 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.502949 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
I20260811 00:53:16.503674 23226 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:16.503779 23226 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:16.503948 23226 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:16.504468 22874 ts_manager.cc:194] Registered new tserver with Master: 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629)
I20260811 00:53:16.505054 22874 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:33859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:53:16.521420 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:16.604243 23237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:16.604497 23237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:16.604532 23237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:16.605674 23237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:16.605715 23237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:16.605751 23237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:53:16.607208 23237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:16.607446 23237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:16.607650 23237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:16.612470 23246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.612506 23237 server_base.cc:1034] running on GCE node
W20260811 00:53:16.612438 23251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:16.612450 23247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.612818 23237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:16.613032 23237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:16.614185 23237 hybrid_clock.cc:648] HybridClock initialized: now 1786409596614171 us; error 29 us; skew 500 ppm
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:16.616680 23237 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:53:16.617127 23237 webserver.cc:460] Webserver started at http://127.26.99.130:42051/ using document root <none> and password file <none>
I20260811 00:53:16.617312 23237 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:16.617353 23237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:16.617447 23237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:53:16.618494 23237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "57a803f537534ca0b24b5e061ffce854"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "c59a3e2a72d3a2d574d8a3fb63571457"
server_key_iv: "905476f97f54993c5feb054748546aa8"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.618784 23237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "57a803f537534ca0b24b5e061ffce854"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "c59a3e2a72d3a2d574d8a3fb63571457"
server_key_iv: "905476f97f54993c5feb054748546aa8"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.620047 23237 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:53:16.620824 23259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.621040 23237 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:16.621138 23237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "57a803f537534ca0b24b5e061ffce854"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "c59a3e2a72d3a2d574d8a3fb63571457"
server_key_iv: "905476f97f54993c5feb054748546aa8"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.621201 23237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:16.634840 23237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:16.636653 23237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:16.636788 23237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:16.636993 23237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:16.637303 23237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:16.637346 23237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.637375 23237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:16.637392 23237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.642786 23237 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:43099
I20260811 00:53:16.642853 23463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:43099 every 8 connection(s)
I20260811 00:53:16.643137 23237 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:53:16.647388 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 23237
I20260811 00:53:16.647508 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:53:16.647734 27022 external_mini_cluster.cc:1428] Setting key efb0140058f988ff5ef289d1497d3e7d
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:16.652467 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.643824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:40589 (local address 127.26.99.190:37143)
0811 00:53:16.643873 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.643874 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.644050 (+ 176us) server_negotiation.cc:407] Connection header received
0811 00:53:16.644616 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.644618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.644628 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.644677 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:16.645584 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.646083 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.647069 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.647268 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.647326 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.649850 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:16.649851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:16.649851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:16.649858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:16.651090 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.651468 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.651470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.651470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.651545 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.651785 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.651785 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.651786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.651920 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:16.651988 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.652273 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.652380 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:53:16.652617 23469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.643770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:40589)
0811 00:53:16.643931 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.643973 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.644502 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.644742 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.644745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.645318 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:16.645516 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.645521 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.646162 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.646163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.646963 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.646966 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.647349 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.647350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.647502 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.648071 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:16.648081 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:16.649751 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:16.651169 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.651176 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.651178 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.651400 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.651602 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.651603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.651603 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.651721 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.652008 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:16.652015 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:16.652143 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.652236 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.652403 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260811 00:53:16.653097 23465 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:16.653213 23465 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:16.653419 23465 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:16.653843 22874 ts_manager.cc:194] Registered new tserver with Master: 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099)
I20260811 00:53:16.654213 22874 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:40589
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:53:16.674625 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:16.756767 23474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:16.756973 23474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:16.757004 23474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:16.758108 23474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:16.758148 23474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:16.758183 23474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:53:16.759588 23474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:16.759812 23474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:16.760022 23474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:16.764876 23481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.765033 23474 server_base.cc:1034] running on GCE node
W20260811 00:53:16.764868 23485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:16.764868 23482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:16.765323 23474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:16.765563 23474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:16.766713 23474 hybrid_clock.cc:648] HybridClock initialized: now 1786409596766718 us; error 56 us; skew 500 ppm
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:16.769181 23474 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:53:16.769640 23474 webserver.cc:460] Webserver started at http://127.26.99.131:35069/ using document root <none> and password file <none>
I20260811 00:53:16.769845 23474 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:16.769891 23474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:16.770016 23474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:53:16.771049 23474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "d05298e9a47e41fd9201a069f3eac52a"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "346856113d05b2bba01891467a52f521"
server_key_iv: "24cca31a8395b10cc7b5c1e7f9908a8e"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.771389 23474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "d05298e9a47e41fd9201a069f3eac52a"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "346856113d05b2bba01891467a52f521"
server_key_iv: "24cca31a8395b10cc7b5c1e7f9908a8e"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.772713 23474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:53:16.773430 23497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.773586 23474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:53:16.773674 23474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "d05298e9a47e41fd9201a069f3eac52a"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "346856113d05b2bba01891467a52f521"
server_key_iv: "24cca31a8395b10cc7b5c1e7f9908a8e"
server_key_version: "encryptionkey@0"
I20260811 00:53:16.773733 23474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:16.823072 23474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:16.825405 23474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:16.825559 23474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:16.825795 23474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:16.826103 23474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:16.826138 23474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.826167 23474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:16.826191 23474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:16.831889 23474 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:37963
I20260811 00:53:16.831954 23701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:37963 every 8 connection(s)
I20260811 00:53:16.832233 23474 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:53:16 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409596, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:16.840611 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 23474
I20260811 00:53:16.840714 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:53:16.840904 27022 external_mini_cluster.cc:1428] Setting key 1e427c3b172f98918a32bb6c5078df0b
I20260811 00:53:16.841213 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.832875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:59627 (local address 127.26.99.190:37143)
0811 00:53:16.832930 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.832931 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.833150 (+ 219us) server_negotiation.cc:407] Connection header received
0811 00:53:16.834120 (+ 970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.834121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.834132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.834199 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:16.834804 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.835304 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.836421 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.836626 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.836682 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.838712 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:16.838713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:16.838714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:16.838720 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:16.839778 (+ 1058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.840123 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.840123 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.840124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.840165 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.840479 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.840480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.840480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.840620 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:16.840694 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.841044 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.841124 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:53:16.841393 23706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.832864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:59627)
0811 00:53:16.833037 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.833071 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.834009 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.834251 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.834254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.834490 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:16.834710 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.834715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.835478 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.835479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.836311 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.836314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.836696 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.836697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.836829 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.837296 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:16.837304 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:16.838621 (+ 1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:16.839845 (+ 1224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.839851 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.839853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.840057 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.840240 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:16.840242 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:16.840242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:16.840404 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:16.840716 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:16.840725 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:16.840866 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.840986 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.841162 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 00:53:16.841825 23702 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:16.841924 23702 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:16.842079 23702 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:16.842410 22874 ts_manager.cc:194] Registered new tserver with Master: d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
I20260811 00:53:16.842842 22874 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:59627
I20260811 00:53:16.852846 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:53:16.859938 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.854092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50456 (local address 127.26.99.190:37143)
0811 00:53:16.854175 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.854178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.854265 (+ 87us) server_negotiation.cc:407] Connection header received
0811 00:53:16.854325 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.854326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.854336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.854382 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:16.854917 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.855392 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.856213 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.856476 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.856539 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.857650 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:16.857652 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:16.857652 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:16.857659 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:16.858902 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.859203 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.859204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.859205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.859258 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:16.859425 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:16.859426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:16.859426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:16.859571 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:16.859659 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.859767 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.859841 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 00:53:16.861440 22874 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:53:16.863039 22874 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:53:16.869088 23724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.865391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37963 (local address 127.0.0.1:35800)
0811 00:53:16.865536 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.865575 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.865639 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.865855 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.865858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.865861 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:16.865927 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.865928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.866959 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.866960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.867806 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.867808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.868784 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.868785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.868873 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.868887 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.868962 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.869012 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260811 00:53:16.869118 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.865494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.26.99.131:37963)
0811 00:53:16.865701 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.865706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.865715 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:53:16.865752 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.865755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.865769 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.865830 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:16.866019 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.866872 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.867920 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.868703 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.868774 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.868830 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.868988 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.869037 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":90,"threads_started":1}
I20260811 00:53:16.869659 23721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.865393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.0.0.1:46400)
0811 00:53:16.865542 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.865578 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.865638 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.866325 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.866326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.866328 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:16.866371 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.866372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.867671 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.867672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.868599 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.868601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.869461 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.869462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.869524 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.869529 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.869558 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.869593 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":14,"thread_start_us":58,"threads_started":1}
I20260811 00:53:16.869817 23733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.866004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.26.99.130:43099)
0811 00:53:16.866189 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.866193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.866200 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:53:16.866232 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.866234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.866246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.866486 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:16.866558 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.867593 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.868903 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.869492 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.869570 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.869633 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.869692 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.869736 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":87,"threads_started":1}
I20260811 00:53:16.870194 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.865766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46400 (local address 127.26.99.129:44629)
0811 00:53:16.866162 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:16.866166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:16.866177 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:53:16.866219 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:16.866221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:16.866236 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:16.866316 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:16.866440 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.867547 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.868679 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.869364 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.869990 (+ 626us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.870054 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:16.870078 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 00:53:16.870116 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260811 00:53:16.870263 23582 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfa29cfdad74568a673957f3982408e (DEFAULT_TABLE table=test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:16.870658 23582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfa29cfdad74568a673957f3982408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:16.870785 23109 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfa29cfdad74568a673957f3982408e (DEFAULT_TABLE table=test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:16.871059 23109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfa29cfdad74568a673957f3982408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:16.873203 23734 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Bootstrap starting.
I20260811 00:53:16.873431 23726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:16.865597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:43099 (local address 127.0.0.1:55142)
0811 00:53:16.866022 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:16.866032 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:16.866079 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:16.866341 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:16.866342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:16.866344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:16.866399 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.866400 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.867687 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.867689 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.868838 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:16.868842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:16.869575 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:16.869576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:16.869627 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:16.869630 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:53:16.869679 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:53:16.869712 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":35,"thread_start_us":80,"threads_started":1}
I20260811 00:53:16.873839 23735 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap starting.
I20260811 00:53:16.873893 23734 tablet_bootstrap.cc:654] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:16.874156 23345 tablet_service.cc:1467] Processing CreateTablet for tablet 4dfa29cfdad74568a673957f3982408e (DEFAULT_TABLE table=test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:16.874347 23735 tablet_bootstrap.cc:654] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:16.874465 23734 log.cc:824] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:16.874522 23345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dfa29cfdad74568a673957f3982408e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:16.874861 23735 log.cc:824] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:16.875299 23734 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: No bootstrap required, opened a new log
I20260811 00:53:16.875360 23734 ts_tablet_manager.cc:1397] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:53:16.875500 23735 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: No bootstrap required, opened a new log
I20260811 00:53:16.875543 23735 ts_tablet_manager.cc:1397] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:53:16.877239 23735 raft_consensus.cc:348] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.877307 23734 raft_consensus.cc:348] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.877449 23735 raft_consensus.cc:374] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:16.877493 23735 raft_consensus.cc:729] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c3359df6254c6fbc9e0a0dece77dea, State: Initialized, Role: FOLLOWER
I20260811 00:53:16.877521 23734 raft_consensus.cc:374] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:16.877611 23735 consensus_queue.cc:260] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.877645 23734 raft_consensus.cc:729] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d05298e9a47e41fd9201a069f3eac52a, State: Initialized, Role: FOLLOWER
I20260811 00:53:16.877779 23734 consensus_queue.cc:260] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.877943 23226 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
I20260811 00:53:16.878063 23734 ts_tablet_manager.cc:1428] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:53:16.878074 23702 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
I20260811 00:53:16.878257 23735 ts_tablet_manager.cc:1428] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:53:16.878257 23740 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Bootstrap starting.
I20260811 00:53:16.878849 23740 tablet_bootstrap.cc:654] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:16.879372 23740 log.cc:824] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:16.880031 23740 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: No bootstrap required, opened a new log
I20260811 00:53:16.880084 23740 ts_tablet_manager.cc:1397] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:53:16.881521 23740 raft_consensus.cc:348] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.881657 23740 raft_consensus.cc:374] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:16.881680 23740 raft_consensus.cc:729] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57a803f537534ca0b24b5e061ffce854, State: Initialized, Role: FOLLOWER
I20260811 00:53:16.881781 23740 consensus_queue.cc:260] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:16.882017 23740 ts_tablet_manager.cc:1428] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:53:16.882061 23465 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
W20260811 00:53:16.893666 23467 tablet.cc:2369] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:53:16.993832 23228 tablet.cc:2369] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:53:17.035580 23746 raft_consensus.cc:482] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:17.035738 23746 raft_consensus.cc:504] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:17.036142 23746 leader_election.cc:288] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
I20260811 00:53:17.039130 23469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.036467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37963 (local address 127.26.99.130:37001)
0811 00:53:17.036528 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:17.036540 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:17.036589 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:17.036732 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:17.036732 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:17.036734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:17.036805 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:17.036807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.037423 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.037424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:17.038322 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:17.038325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.038881 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.038881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:17.038955 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:17.038958 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:53:17.039004 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:53:17.039056 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 00:53:17.039130 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.036544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:37001 (local address 127.26.99.131:37963)
0811 00:53:17.036591 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:17.036593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:17.036602 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:53:17.036654 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:17.036655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:17.036665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:17.036719 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:17.036866 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.037345 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.038414 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.038802 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.038868 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:17.038877 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:17.039019 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 00:53:17.039056 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:53:17.039489 23748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.036467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.26.99.130:50125)
0811 00:53:17.036672 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:17.036681 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:17.036744 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:17.036976 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:17.036977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:17.036980 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:17.037056 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:17.037058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.037651 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.037652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:17.038629 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:17.038632 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.039198 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.039199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:17.039277 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:17.039281 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:53:17.039363 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 00:53:17.039411 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":20,"thread_start_us":118,"threads_started":1}
I20260811 00:53:17.039505 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.036512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:50125 (local address 127.26.99.129:44629)
0811 00:53:17.036575 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:17.036577 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:17.036750 (+ 173us) server_negotiation.cc:407] Connection header received
0811 00:53:17.036902 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:17.036904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:17.036915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:17.036964 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:17.037117 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.037577 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.038745 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.039115 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.039180 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:17.039189 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:17.039400 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 00:53:17.039453 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 00:53:17.039530 23620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfa29cfdad74568a673957f3982408e" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05298e9a47e41fd9201a069f3eac52a" is_pre_election: true
I20260811 00:53:17.039698 23620 raft_consensus.cc:2454] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 0.
I20260811 00:53:17.039850 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfa29cfdad74568a673957f3982408e" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c3359df6254c6fbc9e0a0dece77dea" is_pre_election: true
I20260811 00:53:17.040011 23140 raft_consensus.cc:2454] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 0.
I20260811 00:53:17.039999 23264 leader_election.cc:302] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a; no voters:
I20260811 00:53:17.040128 23746 raft_consensus.cc:2781] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:53:17.040208 23746 raft_consensus.cc:482] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:53:17.040241 23746 raft_consensus.cc:3037] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:17.040961 23746 raft_consensus.cc:504] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:17.041100 23746 leader_election.cc:288] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 election: Requested vote from peers 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
I20260811 00:53:17.041265 23620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfa29cfdad74568a673957f3982408e" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05298e9a47e41fd9201a069f3eac52a"
I20260811 00:53:17.041311 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dfa29cfdad74568a673957f3982408e" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c3359df6254c6fbc9e0a0dece77dea"
I20260811 00:53:17.041359 23620 raft_consensus.cc:3037] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:17.041379 23140 raft_consensus.cc:3037] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:17.042217 23140 raft_consensus.cc:2454] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 1.
I20260811 00:53:17.042217 23620 raft_consensus.cc:2454] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 1.
I20260811 00:53:17.042438 23263 leader_election.cc:302] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a803f537534ca0b24b5e061ffce854, 86c3359df6254c6fbc9e0a0dece77dea; no voters:
I20260811 00:53:17.042558 23746 raft_consensus.cc:2781] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:53:17.042740 23746 raft_consensus.cc:686] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 1 LEADER]: Becoming Leader. State: Replica: 57a803f537534ca0b24b5e061ffce854, State: Running, Role: LEADER
I20260811 00:53:17.042831 23746 consensus_queue.cc:237] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:17.043642 22869 catalog_manager.cc:5495] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57a803f537534ca0b24b5e061ffce854 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "57a803f537534ca0b24b5e061ffce854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } health_report { overall_health: HEALTHY } } }
I20260811 00:53:17.049078 23733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.046834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55152 (local address 127.26.99.130:43099)
0811 00:53:17.046879 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:17.046881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:17.046890 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:53:17.046938 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:17.046939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:17.046956 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:17.047021 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:53:17.047139 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.047602 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.048317 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:17.048553 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:17.048609 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:17.048757 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:53:17.048853 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:53:17.048923 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:17.048961 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 00:53:17.048987 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:53:17.050788 23140 raft_consensus.cc:1261] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Refusing update from remote peer 57a803f537534ca0b24b5e061ffce854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:53:17.050786 23620 raft_consensus.cc:1261] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Refusing update from remote peer 57a803f537534ca0b24b5e061ffce854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:53:17.051124 23750 consensus_queue.cc:1035] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:53:17.051247 23746 consensus_queue.cc:1035] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:53:17.053833 23757 mvcc.cc:205] Tried to move back new op lower bound from 7317133709517385728 to 7317133709487910912. Current Snapshot: MvccSnapshot[applied={T|T < 7317133709517385728}]
I20260811 00:53:17.056023 22874 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:53:17.056123 22874 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:53:17.056856 22874 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Sending DeleteTablet for 3 replicas of tablet 4dfa29cfdad74568a673957f3982408e
I20260811 00:53:17.057185 23582 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dfa29cfdad74568a673957f3982408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:35800
I20260811 00:53:17.057416 23769 tablet_replica.cc:330] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: stopping tablet replica
I20260811 00:53:17.057426 23109 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dfa29cfdad74568a673957f3982408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46400
I20260811 00:53:17.057514 23769 raft_consensus.cc:2229] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:53:17.057621 23769 raft_consensus.cc:2258] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:17.057633 23345 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dfa29cfdad74568a673957f3982408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:55142
I20260811 00:53:17.057860 23777 tablet_replica.cc:330] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: stopping tablet replica
I20260811 00:53:17.057930 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 22992
I20260811 00:53:17.057999 23777 raft_consensus.cc:2229] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:53:17.058051 23769 ts_tablet_manager.cc:1905] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:53:17.058111 23777 raft_consensus.cc:2258] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:17.058506 23777 ts_tablet_manager.cc:1905] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:53:17.059695 23769 ts_tablet_manager.cc:1918] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:53:17.059757 23769 log.cc:1196] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/4dfa29cfdad74568a673957f3982408e
I20260811 00:53:17.060045 23769 ts_tablet_manager.cc:1939] T 4dfa29cfdad74568a673957f3982408e P d05298e9a47e41fd9201a069f3eac52a: Deleting consensus metadata
I20260811 00:53:17.060097 23777 ts_tablet_manager.cc:1918] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:53:17.060153 23777 log.cc:1196] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/4dfa29cfdad74568a673957f3982408e
I20260811 00:53:17.060489 23777 ts_tablet_manager.cc:1939] T 4dfa29cfdad74568a673957f3982408e P 57a803f537534ca0b24b5e061ffce854: Deleting consensus metadata
I20260811 00:53:17.060518 22849 catalog_manager.cc:4841] TS d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): tablet 4dfa29cfdad74568a673957f3982408e (table test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]) successfully deleted
I20260811 00:53:17.060830 22849 catalog_manager.cc:4841] TS 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): tablet 4dfa29cfdad74568a673957f3982408e (table test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]) successfully deleted
W20260811 00:53:17.076485 22847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:44629 (error 108)
I20260811 00:53:17.076750 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 23237
I20260811 00:53:17.077099 23726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:17.076982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.0.0.1:46402)
0811 00:53:17.077033 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:17.077063 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 00:53:17.077194 22847 catalog_manager.cc:4584] TS 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4dfa29cfdad74568a673957f3982408e: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44629: connect: Connection refused (error 111)
I20260811 00:53:17.090008 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 23474
I20260811 00:53:17.103559 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 22818
I20260811 00:53:37.121618 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--webserver_interface=127.26.99.190
--webserver_port=43867
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:37.204782 23780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:37.204975 23780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:37.204995 23780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:37.206073 23780 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:53:37.206103 23780 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:53:37.206115 23780 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:53:37.206125 23780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:53:37.206136 23780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:37.206148 23780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:37.206158 23780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:53:37.206184 23780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:53:37.207639 23780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=43867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:37.207837 23780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:37.208019 23780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:37.217249 23796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.217303 23790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.217250 23798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:37.217289 23780 server_base.cc:1034] running on GCE node
I20260811 00:53:37.217810 23780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:37.218091 23780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:37.219252 23780 hybrid_clock.cc:648] HybridClock initialized: now 1786409617219241 us; error 34 us; skew 500 ppm
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:37.225965 23780 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:53:37.226452 23780 webserver.cc:460] Webserver started at http://127.26.99.190:43867/ using document root <none> and password file <none>
I20260811 00:53:37.226707 23780 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:37.226774 23780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:37.228179 23780 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.228991 23814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.229199 23780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:37.229295 23780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "d2fb3ecc406b4a20a987b01d2307ccd7"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "1447d0f70058831c0c5f098a40fb4122"
server_key_iv: "f0aee740aafcc1a2d852af8fc260a316"
server_key_version: "encryptionkey@0"
I20260811 00:53:37.229714 23780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:37.249074 23780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:37.250941 23780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:37.251080 23780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:37.255164 23780 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37143
I20260811 00:53:37.255218 23901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37143 every 8 connection(s)
I20260811 00:53:37.255587 23780 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:53:37.257125 23903 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:53:37.257782 23903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap starting.
I20260811 00:53:37.257988 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 23780
I20260811 00:53:37.258261 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:44629
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=44997
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:53:37.266223 23903 log.cc:824] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:37.268087 23903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:53:37.268386 23903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap complete.
I20260811 00:53:37.270481 23903 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:37.270705 23903 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Initialized, Role: FOLLOWER
I20260811 00:53:37.270848 23903 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:37.270905 23903 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:53:37.270951 23903 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:53:37.270998 23903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 1 FOLLOWER]: Advancing to term 2
I20260811 00:53:37.271975 23903 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:37.272073 23903 leader_election.cc:302] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2fb3ecc406b4a20a987b01d2307ccd7; no voters:
I20260811 00:53:37.272257 23903 leader_election.cc:288] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 00:53:37.272312 23913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 00:53:37.272485 23913 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 LEADER]: Becoming Leader. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Running, Role: LEADER
I20260811 00:53:37.272552 23903 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:53:37.272576 23913 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:37.272979 23913 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2fb3ecc406b4a20a987b01d2307ccd7. Latest consensus state: current_term: 2 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:37.273015 23914 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:37.273108 23914 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:37.273065 23913 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:37.273634 23930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:53:37.274334 23930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:53:37.274544 23930 catalog_manager.cc:1259] Loaded cluster ID: b9dacecea0ce474291ed54122884ea01
I20260811 00:53:37.274583 23930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:53:37.275364 23930 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:53:37.275552 23930 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Loaded TSK: 0
I20260811 00:53:37.284824 23930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Generated new TSK 1
I20260811 00:53:37.284915 23930 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:53:37.350076 23910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:37.350276 23910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:37.350306 23910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:37.351424 23910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:37.351473 23910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:37.351508 23910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:53:37.353024 23910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:44629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=44997
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:37.353251 23910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:37.353473 23910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:37.359352 23961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.359398 23958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.359369 23959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:37.359560 23910 server_base.cc:1034] running on GCE node
I20260811 00:53:37.359921 23910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:37.360157 23910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:37.361294 23910 hybrid_clock.cc:648] HybridClock initialized: now 1786409617361276 us; error 37 us; skew 500 ppm
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:37.363804 23910 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:53:37.364225 23910 webserver.cc:460] Webserver started at http://127.26.99.129:44997/ using document root <none> and password file <none>
I20260811 00:53:37.364475 23910 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:37.364533 23910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:37.365922 23910 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.366613 23974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.366760 23910 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:53:37.366848 23910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "86c3359df6254c6fbc9e0a0dece77dea"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "93b11b7db0c8450093ba5af8a29bb097"
server_key_iv: "6770ed41ac89c67f52c26bceb9ad89a1"
server_key_version: "encryptionkey@0"
I20260811 00:53:37.367204 23910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:37.397593 23910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:37.399976 23910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:37.400118 23910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:37.400377 23910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:37.400854 23985 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:53:37.402410 23910 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:53:37.402459 23910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:53:37.402484 23910 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:53:37.403143 23910 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:53:37.403187 23910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:37.403256 23985 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap starting.
I20260811 00:53:37.410670 23910 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:44629
I20260811 00:53:37.410764 24183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:44629 every 8 connection(s)
I20260811 00:53:37.411186 23910 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:53:37.414096 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 23910
I20260811 00:53:37.414188 23985 log.cc:824] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:37.414418 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:43099
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=42051
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:53:37.416659 23985 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:53:37.416910 23985 tablet_bootstrap.cc:492] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap complete.
I20260811 00:53:37.417900 23985 ts_tablet_manager.cc:1397] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:37.419030 23985 raft_consensus.cc:348] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:37.419255 23985 raft_consensus.cc:729] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c3359df6254c6fbc9e0a0dece77dea, State: Initialized, Role: FOLLOWER
I20260811 00:53:37.419421 23985 consensus_queue.cc:260] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } }
I20260811 00:53:37.419684 23985 ts_tablet_manager.cc:1428] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:53:37.423053 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.412064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:56423 (local address 127.26.99.190:37143)
0811 00:53:37.412252 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.412262 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.412379 (+ 117us) server_negotiation.cc:407] Connection header received
0811 00:53:37.412981 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.412986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.413028 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.413144 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.413771 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.415036 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.416493 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.417099 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.417218 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.419830 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.419835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.419835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.419848 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.421359 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.421840 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.421841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.421842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.421920 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.422181 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.422182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.422182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.422393 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.422452 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.422793 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.422902 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":78,"threads_started":1}
I20260811 00:53:37.423225 24189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.411997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:56423)
0811 00:53:37.412224 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.412273 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.412767 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.413189 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.413193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.413462 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:37.413651 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.413657 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.415173 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.415174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.416407 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.416410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.417225 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.417226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.417372 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.417875 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:37.417885 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:37.419687 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:37.421446 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.421454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.421456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.421764 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.421979 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.421979 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.421980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.422121 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.422456 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:37.422463 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:37.422630 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.422750 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.422928 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":110,"threads_started":1}
I20260811 00:53:37.424008 24184 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:37.424103 24184 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:37.424275 24184 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:37.425128 23836 ts_manager.cc:194] Registered new tserver with Master: 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629)
I20260811 00:53:37.426347 23836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:56423
I20260811 00:53:37.427316 24184 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.129@KRBTEST.COM
I20260811 00:53:37.433547 24197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.425831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43994 (local address 127.26.99.129:44629)
0811 00:53:37.426004 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.426008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.426108 (+ 100us) server_negotiation.cc:407] Connection header received
0811 00:53:37.426192 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.426194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.426210 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.426266 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.426766 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.427691 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.428466 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.428751 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.428810 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.430912 (+ 2102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.430918 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.430919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.430932 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.432275 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.432731 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.432733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.432733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.432783 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.432989 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.432989 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.432990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.433123 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.433196 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.433404 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.433487 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":81,"threads_started":1}
I20260811 00:53:37.433581 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.425771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.0.0.1:43994)
0811 00:53:37.426005 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.426037 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.426111 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.426274 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.426278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.426588 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:37.426643 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.426646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.427778 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.427779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.428391 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.428394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.428818 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.428819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.428901 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.429336 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:37.429340 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:37.430837 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:37.432375 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.432382 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.432384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.432653 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.432840 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.432840 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.432841 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.432931 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.433185 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:37.433193 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:37.433246 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.433350 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.433482 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":94,"threads_started":1}
I20260811 00:53:37.434193 24067 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dfa29cfdad74568a673957f3982408e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:17 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:43994
I20260811 00:53:37.434784 24198 tablet_replica.cc:330] stopping tablet replica
I20260811 00:53:37.434883 24198 raft_consensus.cc:2229] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:53:37.434949 24198 raft_consensus.cc:2258] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:37.435237 24198 ts_tablet_manager.cc:1905] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:53:37.437142 24198 ts_tablet_manager.cc:1918] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:53:37.437208 24198 log.cc:1196] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal/wals/4dfa29cfdad74568a673957f3982408e
I20260811 00:53:37.437404 24198 ts_tablet_manager.cc:1939] T 4dfa29cfdad74568a673957f3982408e P 86c3359df6254c6fbc9e0a0dece77dea: Deleting consensus metadata
I20260811 00:53:37.437969 23817 catalog_manager.cc:4841] TS 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629): tablet 4dfa29cfdad74568a673957f3982408e (table test-table [id=2bf83c2fc7d642e3b8f3941992c1590d]) successfully deleted
W20260811 00:53:37.501962 24193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:37.502169 24193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:37.502192 24193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:37.503350 24193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:37.503393 24193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:37.503418 24193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:53:37.504876 24193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:43099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=42051
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:37.505100 24193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:37.505334 24193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:37.510247 24207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.510264 24205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.510264 24209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:37.510459 24193 server_base.cc:1034] running on GCE node
I20260811 00:53:37.510720 24193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:37.510977 24193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:37.512135 24193 hybrid_clock.cc:648] HybridClock initialized: now 1786409617512122 us; error 30 us; skew 500 ppm
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:37.514669 24193 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:53:37.515098 24193 webserver.cc:460] Webserver started at http://127.26.99.130:42051/ using document root <none> and password file <none>
I20260811 00:53:37.515295 24193 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:37.515362 24193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:37.517006 24193 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:53:37.517685 24224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.517896 24193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.517988 24193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "57a803f537534ca0b24b5e061ffce854"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "c59a3e2a72d3a2d574d8a3fb63571457"
server_key_iv: "905476f97f54993c5feb054748546aa8"
server_key_version: "encryptionkey@0"
I20260811 00:53:37.518330 24193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:37.535143 24193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:37.537323 24193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:37.537508 24193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:37.537768 24193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:37.538089 24193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:37.538123 24193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.538152 24193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:37.538175 24193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.543784 24193 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:43099
I20260811 00:53:37.543861 24438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:43099 every 8 connection(s)
I20260811 00:53:37.544173 24193 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:37.551614 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 24193
I20260811 00:53:37.552021 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:37963
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=35069
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:53:37.553815 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.544939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:52115 (local address 127.26.99.190:37143)
0811 00:53:37.545013 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.545015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.545196 (+ 181us) server_negotiation.cc:407] Connection header received
0811 00:53:37.545705 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.545707 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.545721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.545789 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.546777 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.547316 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.548380 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.548608 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.548664 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.550682 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.550684 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.550684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.550690 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.552153 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.552672 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.552674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.552674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.552739 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.553029 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.553031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.553031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.553164 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.553237 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.553614 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.553720 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:53:37.554273 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.544913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:52115)
0811 00:53:37.545069 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.545113 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.545599 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.545850 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.545854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.546458 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:37.546666 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.546671 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.547432 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.547433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.548260 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.548263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.548679 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.548680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.548790 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.549241 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:37.549248 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:37.550598 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:37.552252 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.552261 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.552263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.552570 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.552807 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.552808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.552808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.552941 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.553235 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:37.553242 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:37.553410 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.553914 (+ 504us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.554106 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260811 00:53:37.554744 24443 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:37.554833 24443 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:37.555048 24443 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:37.555436 23836 ts_manager.cc:194] Registered new tserver with Master: 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099)
I20260811 00:53:37.555898 23836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:52115
W20260811 00:53:37.635936 24447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:37.636135 24447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:37.636157 24447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:37.637266 24447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:37.637300 24447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:37.637324 24447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:53:37.638720 24447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:37963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=35069
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:37.638909 24447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:37.639093 24447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:37.643908 24462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:37.644033 24447 server_base.cc:1034] running on GCE node
W20260811 00:53:37.643898 24454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:37.643913 24455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:37.644520 24447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:37.644757 24447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:37.645896 24447 hybrid_clock.cc:648] HybridClock initialized: now 1786409617645884 us; error 28 us; skew 500 ppm
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:37.648588 24447 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:53:37.648960 24447 webserver.cc:460] Webserver started at http://127.26.99.131:35069/ using document root <none> and password file <none>
I20260811 00:53:37.649178 24447 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:37.649241 24447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:37.650561 24447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.651230 24470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.651393 24447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.651484 24447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "d05298e9a47e41fd9201a069f3eac52a"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "346856113d05b2bba01891467a52f521"
server_key_iv: "24cca31a8395b10cc7b5c1e7f9908a8e"
server_key_version: "encryptionkey@0"
I20260811 00:53:37.651924 24447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:37.677404 24447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:37.679548 24447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:37.679692 24447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:37.679919 24447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:37.680218 24447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:37.680253 24447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.680282 24447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:37.680306 24447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:37.685863 24447 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:37963
I20260811 00:53:37.685925 24685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:37963 every 8 connection(s)
I20260811 00:53:37.686245 24447 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:53:37.688967 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 24447
Aug 11 00:53:37 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409617, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:53:37.695420 24692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.689404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39334 (local address 127.26.99.190:37143)
0811 00:53:37.689530 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.689532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.689591 (+ 59us) server_negotiation.cc:407] Connection header received
0811 00:53:37.689663 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.689663 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.689674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.689740 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.690289 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.690762 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.691499 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.691695 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.691747 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.692862 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.692863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.692863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.692870 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.694392 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694701 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.694702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.694702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.694761 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694926 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.694927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.694927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.695055 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.695204 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.695243 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.695324 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260811 00:53:37.695603 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.686959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:45071 (local address 127.26.99.190:37143)
0811 00:53:37.687030 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.687032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.687244 (+ 212us) server_negotiation.cc:407] Connection header received
0811 00:53:37.687719 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.687720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.687730 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.687787 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.688783 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.689452 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.690434 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.690668 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.690724 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.692817 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.692818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.692819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.692826 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.694208 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694645 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.694646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.694646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.694704 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694951 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.694952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.694952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.695068 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.695127 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.695436 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.695518 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:53:37.695813 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.686954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:45071)
0811 00:53:37.687119 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.687162 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.687643 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.687851 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.687854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.688473 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:53:37.688670 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.688675 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.689536 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.689537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.690340 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.690343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.690741 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.690742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.690869 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.691376 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:53:37.691385 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:53:37.692728 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:53:37.694293 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694301 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.694303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.694582 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.694762 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:53:37.694763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:53:37.694763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:53:37.694890 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:53:37.695130 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:53:37.695136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:53:37.695288 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.695399 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.695585 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260811 00:53:37.696230 24686 heartbeater.cc:347] Connected to a master server at 127.26.99.190:37143
I20260811 00:53:37.696355 24686 heartbeater.cc:464] Registering TS with master...
I20260811 00:53:37.696533 24686 heartbeater.cc:511] Master 127.26.99.190:37143 requested a full tablet report, sending...
I20260811 00:53:37.696868 23836 ts_manager.cc:194] Registered new tserver with Master: d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
I20260811 00:53:37.697180 23836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:45071
I20260811 00:53:37.707159 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:53:37.709944 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.707514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39348 (local address 127.26.99.190:37143)
0811 00:53:37.707555 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.707558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.707663 (+ 105us) server_negotiation.cc:407] Connection header received
0811 00:53:37.707739 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.707740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.707773 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.707839 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:53:37.707925 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.708464 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.709246 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.709449 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.709503 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.709622 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:53:37.709664 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 00:53:37.709882 (+ 218us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39348: token expired
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 00:53:37.710007 24190 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39348: token expired
W20260811 00:53:37.710069 23708 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.99.190:37143)
I20260811 00:53:37.715617 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.710305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.26.99.190:37143)
0811 00:53:37.710338 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.710339 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.710345 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:53:37.710390 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.710391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.710397 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.710440 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:53:37.710872 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.711294 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.712003 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.712176 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.712226 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.713511 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:53:37.713513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:53:37.713513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:53:37.713519 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:53:37.714770 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.715092 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.715092 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.715093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.715139 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:53:37.715270 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:53:37.715270 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:53:37.715271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:53:37.715356 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:53:37.715425 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.715497 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.715552 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:53:37.716850 23836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:53:37.718421 23836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:53:37.720535 24067 tablet_service.cc:1467] Processing CreateTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 (DEFAULT_TABLE table=test-table [id=1efe90f41a5141539aa083dce65a9091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:37.720742 24067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb0b023ddf524a578870cfa9a1f26ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:37.722225 23985 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap starting.
I20260811 00:53:37.722559 23985 tablet_bootstrap.cc:654] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:37.723111 23985 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: No bootstrap required, opened a new log
I20260811 00:53:37.723161 23985 ts_tablet_manager.cc:1397] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:37.723496 23985 raft_consensus.cc:348] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.723568 23985 raft_consensus.cc:374] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:37.723608 23985 raft_consensus.cc:729] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c3359df6254c6fbc9e0a0dece77dea, State: Initialized, Role: FOLLOWER
I20260811 00:53:37.723655 23985 consensus_queue.cc:260] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.723737 23985 ts_tablet_manager.cc:1428] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:37.724047 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.720249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:43099 (local address 127.0.0.1:49698)
0811 00:53:37.720386 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.720396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.720430 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.720844 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.720845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.720847 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:37.720892 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.720894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.721966 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.721967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.722942 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.722946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.723793 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.723794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.723863 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.723885 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.723930 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.723974 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 00:53:37.724359 24695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.720377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49698 (local address 127.26.99.130:43099)
0811 00:53:37.720601 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.720605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.720616 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:53:37.720657 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.720659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.720675 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.720837 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:37.720981 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.721892 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.723032 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.723633 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.723696 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.723756 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.724210 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.724258 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":103,"threads_started":1}
I20260811 00:53:37.725006 24326 tablet_service.cc:1467] Processing CreateTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 (DEFAULT_TABLE table=test-table [id=1efe90f41a5141539aa083dce65a9091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:37.725325 24326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb0b023ddf524a578870cfa9a1f26ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:37.726200 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.720486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37963 (local address 127.0.0.1:53106)
0811 00:53:37.720757 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.720770 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.720861 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.723119 (+ 2258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.723120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.723123 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:37.723158 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.723159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.724324 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.724325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.725169 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.725172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.726034 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.726035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.726083 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.726086 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.726122 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.726151 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":125,"threads_started":1}
I20260811 00:53:37.726248 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.722797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.26.99.131:37963)
0811 00:53:37.722961 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.722965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.722977 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:53:37.723014 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.723016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.723030 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.723118 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:37.723212 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.724243 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.725242 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.725941 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.726013 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.726067 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.726135 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.726172 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260811 00:53:37.726774 24559 tablet_service.cc:1467] Processing CreateTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 (DEFAULT_TABLE table=test-table [id=1efe90f41a5141539aa083dce65a9091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:53:37.727049 24559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb0b023ddf524a578870cfa9a1f26ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:53:37.728313 24701 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Bootstrap starting.
I20260811 00:53:37.728945 24701 tablet_bootstrap.cc:654] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:37.729528 24701 log.cc:824] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:37.729570 24710 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Bootstrap starting.
I20260811 00:53:37.730080 24710 tablet_bootstrap.cc:654] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Neither blocks nor log segments found. Creating new log.
I20260811 00:53:37.730237 24701 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: No bootstrap required, opened a new log
I20260811 00:53:37.730297 24701 ts_tablet_manager.cc:1397] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:53:37.730589 24710 log.cc:824] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:37.731208 24710 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: No bootstrap required, opened a new log
I20260811 00:53:37.731266 24710 ts_tablet_manager.cc:1397] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:53:37.731845 24701 raft_consensus.cc:348] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.731978 24701 raft_consensus.cc:374] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:37.731999 24701 raft_consensus.cc:729] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57a803f537534ca0b24b5e061ffce854, State: Initialized, Role: FOLLOWER
I20260811 00:53:37.732108 24701 consensus_queue.cc:260] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.732393 24443 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
I20260811 00:53:37.732594 24701 ts_tablet_manager.cc:1428] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:53:37.732856 24710 raft_consensus.cc:348] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.733024 24710 raft_consensus.cc:374] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:53:37.733073 24710 raft_consensus.cc:729] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d05298e9a47e41fd9201a069f3eac52a, State: Initialized, Role: FOLLOWER
I20260811 00:53:37.733183 24710 consensus_queue.cc:260] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.733450 24710 ts_tablet_manager.cc:1428] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:53:37.733467 24686 heartbeater.cc:503] Master 127.26.99.190:37143 was elected leader, sending a full tablet report...
W20260811 00:53:37.794780 24444 tablet.cc:2369] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:53:37.911954 24186 tablet.cc:2369] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:53:37.919590 24718 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:53:37.919718 24718 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.920100 24718 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963), 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629)
I20260811 00:53:37.924010 24197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.920388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:58235 (local address 127.26.99.129:44629)
0811 00:53:37.920432 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.920434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.920573 (+ 139us) server_negotiation.cc:407] Connection header received
0811 00:53:37.920604 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.920605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.920634 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.920693 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:37.920812 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.921527 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923047 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.923676 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923751 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.923817 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.923889 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.923936 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:53:37.924010 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.920454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:56455 (local address 127.26.99.131:37963)
0811 00:53:37.920500 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.920502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.920511 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:53:37.920535 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.920536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.920544 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.920606 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:53:37.920755 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.921541 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923046 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.923617 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923703 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.923715 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.923900 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.923944 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:53:37.924016 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.920281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37963 (local address 127.26.99.130:56455)
0811 00:53:37.920355 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.920367 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.920420 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.920619 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.920620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.920621 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:37.920687 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.920689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.921612 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.921612 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.922936 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.922939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.923720 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.923812 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.923819 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.923877 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.923924 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":73}
I20260811 00:53:37.924022 24720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.920305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.26.99.130:58235)
0811 00:53:37.920504 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.920512 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:37.920562 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:37.920706 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:53:37.920706 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:53:37.920708 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:53:37.920761 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.920762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.921598 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.921599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.922936 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:53:37.922939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.923752 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.923753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:53:37.923812 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.923819 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:53:37.923877 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:53:37.923923 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":47,"thread_start_us":119,"threads_started":1}
I20260811 00:53:37.924468 24597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb0b023ddf524a578870cfa9a1f26ad6" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05298e9a47e41fd9201a069f3eac52a" is_pre_election: true
I20260811 00:53:37.924525 24102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb0b023ddf524a578870cfa9a1f26ad6" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c3359df6254c6fbc9e0a0dece77dea" is_pre_election: true
I20260811 00:53:37.924624 24597 raft_consensus.cc:2454] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 0.
I20260811 00:53:37.924681 24102 raft_consensus.cc:2454] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 0.
I20260811 00:53:37.924853 24231 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a; no voters:
I20260811 00:53:37.924975 24718 raft_consensus.cc:2781] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:53:37.925037 24718 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:53:37.925063 24718 raft_consensus.cc:3037] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:37.925777 24718 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.925899 24718 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 election: Requested vote from peers d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963), 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629)
I20260811 00:53:37.926059 24102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb0b023ddf524a578870cfa9a1f26ad6" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c3359df6254c6fbc9e0a0dece77dea"
I20260811 00:53:37.926142 24102 raft_consensus.cc:3037] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:37.926132 24597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb0b023ddf524a578870cfa9a1f26ad6" candidate_uuid: "57a803f537534ca0b24b5e061ffce854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d05298e9a47e41fd9201a069f3eac52a"
I20260811 00:53:37.926209 24597 raft_consensus.cc:3037] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:53:37.926834 24102 raft_consensus.cc:2454] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 1.
I20260811 00:53:37.926954 24597 raft_consensus.cc:2454] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57a803f537534ca0b24b5e061ffce854 in term 1.
I20260811 00:53:37.927026 24229 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57a803f537534ca0b24b5e061ffce854, 86c3359df6254c6fbc9e0a0dece77dea; no voters:
I20260811 00:53:37.927109 24718 raft_consensus.cc:2781] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:53:37.927242 24718 raft_consensus.cc:686] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 1 LEADER]: Becoming Leader. State: Replica: 57a803f537534ca0b24b5e061ffce854, State: Running, Role: LEADER
I20260811 00:53:37.927330 24718 consensus_queue.cc:237] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:37.928231 23836 catalog_manager.cc:5495] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57a803f537534ca0b24b5e061ffce854 (127.26.99.130). New cstate: current_term: 1 leader_uuid: "57a803f537534ca0b24b5e061ffce854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } health_report { overall_health: UNKNOWN } } }
W20260811 00:53:37.936859 24687 tablet.cc:2369] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:53:37.949946 24695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.947620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.26.99.130:43099)
0811 00:53:37.947677 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:53:37.947680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:53:37.947686 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:53:37.947739 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:53:37.947740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:53:37.947759 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:53:37.947818 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:53:37.947966 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.948495 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.949203 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:53:37.949393 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:53:37.949469 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:53:37.949617 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:53:37.949722 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:53:37.949795 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:53:37.949814 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 00:53:37.949837 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:53:37.951748 24597 raft_consensus.cc:1261] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Refusing update from remote peer 57a803f537534ca0b24b5e061ffce854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:53:37.951809 24102 raft_consensus.cc:1261] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Refusing update from remote peer 57a803f537534ca0b24b5e061ffce854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:53:37.952082 24721 consensus_queue.cc:1035] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:53:37.952211 24718 consensus_queue.cc:1035] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:53:37.954375 24723 mvcc.cc:205] Tried to move back new op lower bound from 7317133795127693312 to 7317133795030872064. Current Snapshot: MvccSnapshot[applied={T|T < 7317133795127693312}]
I20260811 00:53:37.954546 24727 mvcc.cc:205] Tried to move back new op lower bound from 7317133795127693312 to 7317133795030872064. Current Snapshot: MvccSnapshot[applied={T|T < 7317133795127693312}]
I20260811 00:53:37.954988 24724 mvcc.cc:205] Tried to move back new op lower bound from 7317133795127693312 to 7317133795030872064. Current Snapshot: MvccSnapshot[applied={T|T < 7317133795127693312}]
I20260811 00:53:37.956743 23836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:53:37.956830 23836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:53:37.957522 23836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Sending DeleteTablet for 3 replicas of tablet cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:53:37.957815 24067 tablet_service.cc:1514] Processing DeleteTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:37 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:43994
I20260811 00:53:37.957798 24326 tablet_service.cc:1514] Processing DeleteTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:37 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:49698
I20260811 00:53:37.958030 24741 tablet_replica.cc:330] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: stopping tablet replica
I20260811 00:53:37.958031 24559 tablet_service.cc:1514] Processing DeleteTablet for tablet cb0b023ddf524a578870cfa9a1f26ad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:53:37 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:53106
I20260811 00:53:37.958091 24741 raft_consensus.cc:2229] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:53:37.958133 24741 raft_consensus.cc:2258] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:37.958236 24747 tablet_replica.cc:330] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: stopping tablet replica
I20260811 00:53:37.958247 24746 tablet_replica.cc:330] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: stopping tablet replica
I20260811 00:53:37.958293 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 23910
I20260811 00:53:37.958328 24747 raft_consensus.cc:2229] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:53:37.958336 24746 raft_consensus.cc:2229] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:53:37.958413 24746 raft_consensus.cc:2258] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:37.958415 24747 raft_consensus.cc:2258] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:53:37.963985 24747 ts_tablet_manager.cc:1905] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:53:37.966428 24747 ts_tablet_manager.cc:1918] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:53:37.966523 24747 log.cc:1196] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:53:37.967005 24747 ts_tablet_manager.cc:1939] T cb0b023ddf524a578870cfa9a1f26ad6 P d05298e9a47e41fd9201a069f3eac52a: Deleting consensus metadata
I20260811 00:53:37.967516 23818 catalog_manager.cc:4841] TS d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): tablet cb0b023ddf524a578870cfa9a1f26ad6 (table test-table [id=1efe90f41a5141539aa083dce65a9091]) successfully deleted
I20260811 00:53:37.967726 24746 ts_tablet_manager.cc:1905] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:53:37.970916 24746 ts_tablet_manager.cc:1918] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:53:37.971099 24746 log.cc:1196] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:53:37.971407 24746 ts_tablet_manager.cc:1939] T cb0b023ddf524a578870cfa9a1f26ad6 P 57a803f537534ca0b24b5e061ffce854: Deleting consensus metadata
I20260811 00:53:37.971954 23818 catalog_manager.cc:4841] TS 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): tablet cb0b023ddf524a578870cfa9a1f26ad6 (table test-table [id=1efe90f41a5141539aa083dce65a9091]) successfully deleted
W20260811 00:53:37.976061 23817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:44629 (error 108)
I20260811 00:53:37.976423 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 24193
I20260811 00:53:37.985042 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:37.984877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:44629 (local address 127.0.0.1:43996)
0811 00:53:37.984945 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:37.984996 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44629: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 00:53:37.985302 23817 catalog_manager.cc:4584] TS 86c3359df6254c6fbc9e0a0dece77dea (127.26.99.129:44629): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb0b023ddf524a578870cfa9a1f26ad6: Network error: Client connection negotiation failed: client connection to 127.26.99.129:44629: connect: Connection refused (error 111)
I20260811 00:53:37.990545 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 24447
I20260811 00:53:38.004572 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 23780
I20260811 00:53:58.022953 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--webserver_interface=127.26.99.190
--webserver_port=43867
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:58.105801 24753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:58.105994 24753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:58.106015 24753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:58.107132 24753 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 00:53:58.107169 24753 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 00:53:58.107180 24753 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 00:53:58.107191 24753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:53:58.107203 24753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:58.107215 24753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:58.107239 24753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:53:58.107261 24753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:53:58.108858 24753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=43867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:58.109107 24753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:58.109321 24753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:58.114289 24764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:58.114322 24763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.114446 24753 server_base.cc:1034] running on GCE node
W20260811 00:53:58.114289 24767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.114748 24753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:58.115044 24753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:58.116196 24753 hybrid_clock.cc:648] HybridClock initialized: now 1786409638116184 us; error 34 us; skew 500 ppm
Aug 11 00:53:58 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:58.124970 24753 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:53:58.125418 24753 webserver.cc:460] Webserver started at http://127.26.99.190:43867/ using document root <none> and password file <none>
I20260811 00:53:58.125631 24753 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:58.125681 24753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:58.126955 24753 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:53:58.127681 24783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.127857 24753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:58.127945 24753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "d2fb3ecc406b4a20a987b01d2307ccd7"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "1447d0f70058831c0c5f098a40fb4122"
server_key_iv: "f0aee740aafcc1a2d852af8fc260a316"
server_key_version: "encryptionkey@0"
I20260811 00:53:58.128286 24753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:58.136070 24753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:58.137742 24753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:58.137871 24753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:58.141723 24753 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37143
I20260811 00:53:58.141754 24872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37143 every 8 connection(s)
I20260811 00:53:58.142100 24753 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:53:58.143519 24874 sys_catalog.cc:263] Verifying existing consensus state
I20260811 00:53:58.144135 24874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap starting.
I20260811 00:53:58.148972 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 24753
I20260811 00:53:58.149251 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:44629
--local_ip_for_outbound_sockets=127.26.99.129
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=44997
--webserver_interface=127.26.99.129
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:53:58.152870 24874 log.cc:824] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:58.155140 24874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:53:58.155435 24874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: Bootstrap complete.
I20260811 00:53:58.157610 24874 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:58.157847 24874 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Initialized, Role: FOLLOWER
I20260811 00:53:58.157989 24874 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:58.158051 24874 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:53:58.158092 24874 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:53:58.158138 24874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 2 FOLLOWER]: Advancing to term 3
I20260811 00:53:58.159134 24874 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:58.159226 24874 leader_election.cc:302] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2fb3ecc406b4a20a987b01d2307ccd7; no voters:
I20260811 00:53:58.159387 24874 leader_election.cc:288] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 00:53:58.159456 24883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 00:53:58.159660 24883 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [term 3 LEADER]: Becoming Leader. State: Replica: d2fb3ecc406b4a20a987b01d2307ccd7, State: Running, Role: LEADER
I20260811 00:53:58.159775 24883 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } }
I20260811 00:53:58.159651 24874 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:53:58.160096 24885 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2fb3ecc406b4a20a987b01d2307ccd7. Latest consensus state: current_term: 3 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:58.160271 24885 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:58.160378 24884 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2fb3ecc406b4a20a987b01d2307ccd7" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37143 } } }
I20260811 00:53:58.160501 24884 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7 [sys.catalog]: This master's current role is: LEADER
I20260811 00:53:58.161741 24905 catalog_manager.cc:1259] Loaded cluster ID: b9dacecea0ce474291ed54122884ea01
I20260811 00:53:58.161788 24905 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: loading cluster ID for follower catalog manager: success
I20260811 00:53:58.163028 24905 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d2fb3ecc406b4a20a987b01d2307ccd7: acquiring CA information for follower catalog manager: success
F20260811 00:53:58.163403 24905 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fca878aa9ad google::LogMessage::Fail() at ??:0
@ 0x7fca878ad88a google::LogMessage::SendToLog() at ??:0
@ 0x7fca878aa4de google::LogMessage::Flush() at ??:0
@ 0x7fca878aba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fca8a017104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fca8f8036b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fca8f803989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fca8f803e4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fca8f8068c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fca8976d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fca8a5d16db start_thread at ??:0
@ 0x7fca863a861f clone at ??:0
W20260811 00:53:58.244107 24877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:58.244309 24877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:58.244369 24877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:58.245524 24877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:58.245568 24877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:58.245602 24877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:53:58.247048 24877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:44629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=44997
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:58.247285 24877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:58.247486 24877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:58.252182 24951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:58.252177 24950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.252314 24877 server_base.cc:1034] running on GCE node
W20260811 00:53:58.252369 24954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.252694 24877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:58.252915 24877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:58.254072 24877 hybrid_clock.cc:648] HybridClock initialized: now 1786409638254053 us; error 37 us; skew 500 ppm
Aug 11 00:53:58 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:58.256436 24877 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:53:58.256855 24877 webserver.cc:460] Webserver started at http://127.26.99.129:44997/ using document root <none> and password file <none>
I20260811 00:53:58.257059 24877 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:58.257107 24877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:58.258415 24877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 00:53:58.259078 24971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.259230 24877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:53:58.259315 24877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "86c3359df6254c6fbc9e0a0dece77dea"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "93b11b7db0c8450093ba5af8a29bb097"
server_key_iv: "6770ed41ac89c67f52c26bceb9ad89a1"
server_key_version: "encryptionkey@0"
I20260811 00:53:58.259639 24877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:58.272567 24877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:58.274569 24877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:58.274709 24877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:58.274920 24877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:58.275390 24992 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 00:53:58.277403 24877 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 00:53:58.277452 24877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 00:53:58.277477 24877 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 00:53:58.278113 24877 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 00:53:58.278162 24877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 00:53:58.278242 24992 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap starting.
I20260811 00:53:58.285090 24877 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:44629
I20260811 00:53:58.285290 25191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:44629 every 8 connection(s)
I20260811 00:53:58.285549 24877 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:53:58.289291 24992 log.cc:824] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Log is configured to *not* fsync() on all Append() calls
I20260811 00:53:58.291947 24992 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 00:53:58.292274 24992 tablet_bootstrap.cc:492] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Bootstrap complete.
I20260811 00:53:58.293470 24992 ts_tablet_manager.cc:1397] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.007s
I20260811 00:53:58.294865 24992 raft_consensus.cc:348] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:58.295199 24992 raft_consensus.cc:729] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c3359df6254c6fbc9e0a0dece77dea, State: Initialized, Role: FOLLOWER
I20260811 00:53:58.295336 24992 consensus_queue.cc:260] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:53:58.295361 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 24877
I20260811 00:53:58.295612 24992 ts_tablet_manager.cc:1428] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 00:53:58.295640 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:43099
--local_ip_for_outbound_sockets=127.26.99.130
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=42051
--webserver_interface=127.26.99.130
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:58.389358 25194 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:53:58.286169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:58313)
0811 00:53:58.286339 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.286381 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:53:58.286852 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:53:58.389156 (+102304us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
W20260811 00:53:58.389659 25192 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37143 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:37143: Client connection negotiation failed: client connection to 127.26.99.190:37143: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 00:53:58.389973 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.389864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:47637)
0811 00:53:58.389915 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.389954 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 00:53:58.390304 25194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.390225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:41609)
0811 00:53:58.390266 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.390289 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 00:53:58.390416 25192 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 00:53:58.404404 25203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:58.404604 25203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:58.404628 25203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:58.405768 25203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:58.405807 25203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:58.405831 25203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:53:58.407235 25203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:43099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=42051
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:58.407413 25203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:58.407591 25203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:58.412388 25218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:58.412364 25222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:58.412429 25216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.412653 25203 server_base.cc:1034] running on GCE node
I20260811 00:53:58.412832 25203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:58.413062 25203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:58.414222 25203 hybrid_clock.cc:648] HybridClock initialized: now 1786409638414209 us; error 33 us; skew 500 ppm
Aug 11 00:53:58 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:58.416711 25203 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:53:58.417090 25203 webserver.cc:460] Webserver started at http://127.26.99.130:42051/ using document root <none> and password file <none>
I20260811 00:53:58.417286 25203 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:58.417326 25203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:58.418638 25203 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:58.419236 25232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.419391 25203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.419476 25203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "57a803f537534ca0b24b5e061ffce854"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "c59a3e2a72d3a2d574d8a3fb63571457"
server_key_iv: "905476f97f54993c5feb054748546aa8"
server_key_version: "encryptionkey@0"
I20260811 00:53:58.419803 25203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:58.434420 25203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:58.436131 25203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:58.436237 25203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:58.436470 25203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:58.436724 25203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:58.436754 25203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.436779 25203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:58.436794 25203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.442320 25203 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:43099
I20260811 00:53:58.442402 25429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:43099 every 8 connection(s)
I20260811 00:53:58.442687 25203 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:53:58.443737 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.443320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:60367)
0811 00:53:58.443499 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.443571 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":68,"threads_started":1}
W20260811 00:53:58.444094 25431 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37143 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:37143: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
I20260811 00:53:58.444361 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.444256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:39053)
0811 00:53:58.444293 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.444319 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 00:53:58.444589 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.444527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:53281)
0811 00:53:58.444556 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.444577 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 00:53:58.444671 25431 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:53:58.445837 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 25203
I20260811 00:53:58.446084 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:37963
--local_ip_for_outbound_sockets=127.26.99.131
--tserver_master_addrs=127.26.99.190:37143
--webserver_port=35069
--webserver_interface=127.26.99.131
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:43403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:53:58.528537 25437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:53:58.528748 25437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:53:58.528780 25437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:53:58.529950 25437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:53:58.529991 25437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:53:58.530026 25437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:53:58.531468 25437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:37963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=35069
--tserver_master_addrs=127.26.99.190:37143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:53:58.531713 25437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:53:58.531922 25437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:53:58.536978 25444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.537143 25437 server_base.cc:1034] running on GCE node
W20260811 00:53:58.536981 25451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:53:58.537031 25445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:53:58.537403 25437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:53:58.537645 25437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:53:58.538808 25437 hybrid_clock.cc:648] HybridClock initialized: now 1786409638538789 us; error 34 us; skew 500 ppm
Aug 11 00:53:58 dist-test-slave-xt4k krb5kdc[22793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:53:58.541301 25437 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:53:58.541730 25437 webserver.cc:460] Webserver started at http://127.26.99.131:35069/ using document root <none> and password file <none>
I20260811 00:53:58.541930 25437 fs_manager.cc:359] Metadata directory not provided
I20260811 00:53:58.541981 25437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:53:58.543284 25437 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:58.543892 25467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.544088 25437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:53:58.544181 25437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "d05298e9a47e41fd9201a069f3eac52a"
format_stamp: "Formatted at 2026-08-11 00:53:16 on dist-test-slave-xt4k"
server_key: "346856113d05b2bba01891467a52f521"
server_key_iv: "24cca31a8395b10cc7b5c1e7f9908a8e"
server_key_version: "encryptionkey@0"
I20260811 00:53:58.544559 25437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:53:58.565806 25437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:53:58.567986 25437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:53:58.568128 25437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:53:58.568373 25437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:53:58.568681 25437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:53:58.568714 25437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.568744 25437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:53:58.568768 25437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:53:58.574357 25437 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:37963
I20260811 00:53:58.574420 25679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:37963 every 8 connection(s)
I20260811 00:53:58.574767 25437 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:53:58.575785 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.575417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:44827)
0811 00:53:58.575573 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.575643 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
W20260811 00:53:58.576176 25680 heartbeater.cc:644] Failed to heartbeat to 127.26.99.190:37143 (0 consecutive failures): Network error: Failed to ping master at 127.26.99.190:37143: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
I20260811 00:53:58.576421 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.576348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:34479)
0811 00:53:58.576377 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.576403 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260811 00:53:58.576617 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:58.576568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:37253)
0811 00:53:58.576587 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:58.576605 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260811 00:53:58.576697 25680 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 00:53:58.581892 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 25437
I20260811 00:53:59.391045 25684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:59.390771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:34339)
0811 00:53:59.390934 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:59.390977 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":68,"threads_started":1}
I20260811 00:53:59.445160 25685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:59.444950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:60307)
0811 00:53:59.445072 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:59.445107 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 00:53:59.577148 25686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:53:59.576970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:39279)
0811 00:53:59.577074 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 00:53:59.577104 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
I20260811 00:54:00.068542 25687 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:00.068665 25687 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:54:00.068936 25687 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
Aug 11 00:54:00 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.130@KRBTEST.COM
Aug 11 00:54:00 dist-test-slave-xt4k krb5kdc[22793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409638, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.131@KRBTEST.COM
I20260811 00:54:00.078688 25690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.069186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:35937 (local address 127.26.99.130:43099)
0811 00:54:00.069330 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:00.069343 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:00.069368 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:54:00.069841 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:00.069844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:00.069888 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:00.070005 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:00.070821 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.071697 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.072724 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.073110 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.073205 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:00.075306 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:00.075310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:00.075311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:00.075322 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:00.077001 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077455 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:00.077457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:00.077458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:00.077566 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077798 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:00.077799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:00.077799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:00.078090 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:00.078151 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:00.078447 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 00:54:00.078577 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":46,"threads_started":1}
I20260811 00:54:00.078739 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.069454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:50973 (local address 127.26.99.131:37963)
0811 00:54:00.069570 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:00.069580 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:00.069609 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:54:00.070048 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:00.070051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:00.070111 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:00.070247 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:00.070831 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.071692 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.072713 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.073109 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.073207 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:00.075735 (+ 2528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:00.075738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:00.075739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:00.075749 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:00.077436 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077779 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:00.077782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:00.077782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:00.077868 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:00.078041 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:00.078042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:00.078042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:00.078289 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:00.078371 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:00.078534 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 00:54:00.078654 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":56,"threads_started":1}
I20260811 00:54:00.078779 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.069305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:37963 (local address 127.26.99.129:50973)
0811 00:54:00.069398 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:00.069408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:00.069452 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:00.070239 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:00.070240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:00.070505 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:00.070712 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:00.070718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.071789 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.071790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:00.072639 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:00.072641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.073191 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.073192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:00.073299 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:00.073846 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:00.073851 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:00.075627 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:00.077505 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:00.077507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:00.077711 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:00.077925 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077926 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:00.077926 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:00.077986 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:00.078355 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:00.078355 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:00.078399 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 00:54:00.078468 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 00:54:00.078652 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":149,"thread_start_us":51,"threads_started":1}
I20260811 00:54:00.078706 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.069079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:43099 (local address 127.26.99.129:35937)
0811 00:54:00.069231 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:00.069242 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:00.069296 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:00.070083 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:00.070086 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:00.070505 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:00.070712 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:00.070718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.071813 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.071814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:00.072640 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:00.072642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:00.073190 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:00.073191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:00.073300 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:00.073797 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:00.073805 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:00.075206 (+ 1401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:00.077087 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077093 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:00.077096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:00.077368 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:00.077634 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:00.077635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:00.077635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:00.077735 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:00.078153 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:00.078159 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:00.078291 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 00:54:00.078392 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:54:00.078581 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":48,"thread_start_us":106,"threads_started":1}
W20260811 00:54:00.079525 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
W20260811 00:54:00.079602 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:54:00.079623 24985 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c3359df6254c6fbc9e0a0dece77dea; no voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a
I20260811 00:54:00.079725 25687 raft_consensus.cc:2726] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:54:00.391577 25689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.391456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:49899)
0811 00:54:00.391499 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:00.391535 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 00:54:00.445833 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.445579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:43965)
0811 00:54:00.445729 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:00.445782 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260811 00:54:00.577749 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:00.577523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:39215)
0811 00:54:00.577653 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:00.577689 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260811 00:54:01.392258 25705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:01.392053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:59963)
0811 00:54:01.392172 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:01.392210 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260811 00:54:01.446520 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:01.446287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:47831)
0811 00:54:01.446418 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:01.446475 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260811 00:54:01.578320 25710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:01.578144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:47667)
0811 00:54:01.578252 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:01.578280 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260811 00:54:02.197624 25715 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:02.197726 25715 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:54:02.197893 25715 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
W20260811 00:54:02.198372 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
W20260811 00:54:02.198448 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:54:02.198484 24985 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c3359df6254c6fbc9e0a0dece77dea; no voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a
I20260811 00:54:02.198561 25715 raft_consensus.cc:2726] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:54:02.392922 25716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:02.392683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:49993)
0811 00:54:02.392833 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:02.392870 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260811 00:54:02.447223 25717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:02.446967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:51145)
0811 00:54:02.447110 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:02.447147 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260811 00:54:02.578922 25718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:02.578702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:49785)
0811 00:54:02.578839 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:02.578878 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
I20260811 00:54:03.393685 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:03.393426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:37233)
0811 00:54:03.393594 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:03.393635 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260811 00:54:03.447813 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:03.447615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:57407)
0811 00:54:03.447740 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:03.447772 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260811 00:54:03.579527 25724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:03.579319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:54965)
0811 00:54:03.579445 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:03.579488 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":54,"threads_started":1}
I20260811 00:54:03.993415 25725 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:03.993516 25725 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:54:03.993664 25725 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
W20260811 00:54:03.994246 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
W20260811 00:54:03.994346 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:54:03.994386 24985 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c3359df6254c6fbc9e0a0dece77dea; no voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a
I20260811 00:54:03.994457 25725 raft_consensus.cc:2726] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:54:04.394295 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:04.394076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:59291)
0811 00:54:04.394210 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:04.394247 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260811 00:54:04.448393 25727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:04.448172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:59541)
0811 00:54:04.448281 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:04.448316 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":57,"threads_started":1}
I20260811 00:54:04.580255 25728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:04.580037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:34419)
0811 00:54:04.580176 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:04.580212 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":62,"threads_started":1}
I20260811 00:54:05.395094 25729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:05.394813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:48327)
0811 00:54:05.394992 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:05.395042 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260811 00:54:05.449118 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:05.448859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:48021)
0811 00:54:05.449021 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:05.449069 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":62,"threads_started":1}
I20260811 00:54:05.581058 25731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:05.580798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:53527)
0811 00:54:05.580966 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:05.581015 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":65,"threads_started":1}
I20260811 00:54:06.395784 25733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:06.395574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:51685)
0811 00:54:06.395695 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:06.395734 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260811 00:54:06.449815 25739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:06.449592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:34575)
0811 00:54:06.449732 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:06.449769 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
I20260811 00:54:06.581771 25742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:06.581527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:37201)
0811 00:54:06.581679 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:06.581725 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":64,"threads_started":1}
I20260811 00:54:07.396502 25743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:07.396225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:52351)
0811 00:54:07.396391 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:07.396450 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":67,"threads_started":1}
I20260811 00:54:07.450485 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:07.450256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:53673)
0811 00:54:07.450390 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:07.450430 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260811 00:54:07.582473 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:07.582232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:54953)
0811 00:54:07.582391 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:07.582430 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260811 00:54:08.397147 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:08.396916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:52857)
0811 00:54:08.397063 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:08.397099 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260811 00:54:08.451135 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:08.450903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:55997)
0811 00:54:08.451054 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:08.451089 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260811 00:54:08.535079 25754 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:08.535190 25754 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:54:08.535356 25754 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
W20260811 00:54:08.535791 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
W20260811 00:54:08.535856 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:54:08.535884 24985 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c3359df6254c6fbc9e0a0dece77dea; no voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a
I20260811 00:54:08.535969 25754 raft_consensus.cc:2726] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:54:08.583223 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:08.582994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:53047)
0811 00:54:08.583134 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:08.583173 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
I20260811 00:54:09.397928 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:09.397668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:54717)
0811 00:54:09.397836 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:09.397878 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":77,"threads_started":1}
I20260811 00:54:09.451851 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:09.451626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:43769)
0811 00:54:09.451760 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:09.451802 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 00:54:09.583947 25761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:09.583715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:45073)
0811 00:54:09.583867 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:09.583905 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260811 00:54:10.398671 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:10.398449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:44405)
0811 00:54:10.398579 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:10.398621 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260811 00:54:10.452615 25765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:10.452363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:44421)
0811 00:54:10.452526 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:10.452566 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260811 00:54:10.584632 25766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:10.584416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:36687)
0811 00:54:10.584546 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:10.584584 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260811 00:54:11.399390 25767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:11.399171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:40591)
0811 00:54:11.399305 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:11.399341 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260811 00:54:11.453306 25770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:11.453085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:51623)
0811 00:54:11.453217 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:11.453257 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 00:54:11.585279 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:11.585067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:60519)
0811 00:54:11.585199 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:11.585234 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260811 00:54:11.760473 25775 raft_consensus.cc:482] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:11.760565 25775 raft_consensus.cc:504] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57a803f537534ca0b24b5e061ffce854" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 43099 } } peers { permanent_uuid: "d05298e9a47e41fd9201a069f3eac52a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 37963 } } peers { permanent_uuid: "86c3359df6254c6fbc9e0a0dece77dea" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 44629 } }
I20260811 00:54:11.760717 25775 leader_election.cc:288] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099), d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963)
W20260811 00:54:11.761090 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 57a803f537534ca0b24b5e061ffce854 (127.26.99.130:43099): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
W20260811 00:54:11.761150 24985 leader_election.cc:341] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d05298e9a47e41fd9201a069f3eac52a (127.26.99.131:37963): Not found: Tablet not found: cb0b023ddf524a578870cfa9a1f26ad6
I20260811 00:54:11.761168 24985 leader_election.cc:302] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86c3359df6254c6fbc9e0a0dece77dea; no voters: 57a803f537534ca0b24b5e061ffce854, d05298e9a47e41fd9201a069f3eac52a
I20260811 00:54:11.761240 25775 raft_consensus.cc:2726] T cb0b023ddf524a578870cfa9a1f26ad6 P 86c3359df6254c6fbc9e0a0dece77dea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 00:54:12.400126 25777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:12.399890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:49281)
0811 00:54:12.400036 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:12.400077 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260811 00:54:12.453971 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:12.453760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:36995)
0811 00:54:12.453891 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:12.453926 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260811 00:54:12.585974 25787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:12.585759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:54315)
0811 00:54:12.585888 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:12.585925 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260811 00:54:13.400950 25789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:13.400733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.129:58335)
0811 00:54:13.400865 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:13.400901 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 00:54:13.454667 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:13.454439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.130:39449)
0811 00:54:13.454580 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:13.454620 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260811 00:54:13.582307 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 24877
I20260811 00:54:13.590493 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:13.589155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:37143 (local address 127.26.99.131:43313)
0811 00:54:13.590403 (+ 1248us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:13.590442 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.190:37143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1230,"thread_start_us":967,"threads_started":1}
I20260811 00:54:13.595374 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 25203
I20260811 00:54:13.608199 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 25437
2026-08-11T00:54:13Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58743 ms)
[----------] 30 tests from SecurityITest (235893 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:13 dist-test-slave-xt4k krb5kdc[25794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:13 dist-test-slave-xt4k krb5kdc[25794](info): set up 2 sockets
Aug 11 00:54:13 dist-test-slave-xt4k krb5kdc[25794](info): commencing operation
krb5kdc: starting...
W20260811 00:54:14.821918 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:14 dist-test-slave-xt4k krb5kdc[25794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:14.951740 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35253
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:35253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:15.037544 25816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:15.037773 25816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:15.037808 25816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:15.039052 25816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:15.039098 25816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:15.039119 25816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:15.039134 25816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:15.039148 25816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:15.040728 25816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:35253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:15.040982 25816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:15.041251 25816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:15.046782 25824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:15.046852 25825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.046955 25816 server_base.cc:1034] running on GCE node
W20260811 00:54:15.046924 25827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.047276 25816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:15.047634 25816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:15.048801 25816 hybrid_clock.cc:648] HybridClock initialized: now 1786409655048765 us; error 43 us; skew 500 ppm
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:15.051877 25816 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:15.052295 25816 webserver.cc:460] Webserver started at http://127.26.99.190:34349/ using document root <none> and password file <none>
I20260811 00:54:15.052548 25816 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:15.052598 25816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:15.052712 25816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:15.053779 25816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "95deb7db1b6f4c08bd169e265a9bcdef"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "b69a41d794fe9fd0561735a60af7818c"
server_key_iv: "026b9e5243c5e51fc5459b94ff1c367f"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.054116 25816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "95deb7db1b6f4c08bd169e265a9bcdef"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "b69a41d794fe9fd0561735a60af7818c"
server_key_iv: "026b9e5243c5e51fc5459b94ff1c367f"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.055488 25816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:15.056686 25839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.057006 25816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:15.057106 25816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "95deb7db1b6f4c08bd169e265a9bcdef"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "b69a41d794fe9fd0561735a60af7818c"
server_key_iv: "026b9e5243c5e51fc5459b94ff1c367f"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.057173 25816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:15.089468 25816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:15.092857 25816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:15.093043 25816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:15.098978 25816 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:35253
I20260811 00:54:15.099031 25932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:35253 every 8 connection(s)
I20260811 00:54:15.099390 25816 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:15.100420 25935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:15.103068 25935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: Bootstrap starting.
I20260811 00:54:15.103663 25935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:15.103935 25935 log.cc:824] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:15.104671 25935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: No bootstrap required, opened a new log
I20260811 00:54:15.106484 25935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } }
I20260811 00:54:15.106645 25935 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:15.106670 25935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95deb7db1b6f4c08bd169e265a9bcdef, State: Initialized, Role: FOLLOWER
I20260811 00:54:15.106909 25935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } }
I20260811 00:54:15.106999 25935 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:15.107026 25935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:15.107079 25935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:15.107625 25935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } }
I20260811 00:54:15.107825 25935 leader_election.cc:302] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95deb7db1b6f4c08bd169e265a9bcdef; no voters:
I20260811 00:54:15.108211 25935 leader_election.cc:288] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:15.108369 25945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:15.108604 25945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [term 1 LEADER]: Becoming Leader. State: Replica: 95deb7db1b6f4c08bd169e265a9bcdef, State: Running, Role: LEADER
I20260811 00:54:15.108601 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 25816
I20260811 00:54:15.108631 25935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:15.108729 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:15.108798 25945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } }
I20260811 00:54:15.108995 27022 external_mini_cluster.cc:1428] Setting key 9cb06bfdbed4b5fa7c3d1f8c20ddaba6
I20260811 00:54:15.109342 25949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } } }
I20260811 00:54:15.109429 25949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:15.110005 25955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95deb7db1b6f4c08bd169e265a9bcdef. Latest consensus state: current_term: 1 leader_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95deb7db1b6f4c08bd169e265a9bcdef" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35253 } } }
I20260811 00:54:15.110039 25962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:15.110105 25955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:15.110796 25962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:15.112455 25962 catalog_manager.cc:1347] Generated new cluster ID: 37f2d82773524a15949092b12b46cf27
I20260811 00:54:15.112519 25962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:15.121807 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.109927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53382 (local address 127.26.99.190:35253)
0811 00:54:15.110191 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.110202 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.110366 (+ 164us) server_negotiation.cc:407] Connection header received
0811 00:54:15.110501 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.110509 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.110586 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.110769 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:15.111472 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.112829 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.113588 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.114177 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.114298 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.117840 (+ 3542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:15.117848 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:15.117848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:15.117868 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:15.119765 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.120177 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.120181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.120181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.120308 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.120542 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.120543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.120543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.120875 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:15.121100 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.121180 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.121558 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260811 00:54:15.136142 25962 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:15.136864 25962 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:15.146809 25962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: Generated new TSK 0
I20260811 00:54:15.147032 25962 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:54:15.183848 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:15.272652 25990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:15.272856 25990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:15.272878 25990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:15.274026 25990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:15.274066 25990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:15.274092 25990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:15.275556 25990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:15.275787 25990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:15.276043 25990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:15.281344 26006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:15.281344 26004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:15.281457 26001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.281788 25990 server_base.cc:1034] running on GCE node
I20260811 00:54:15.282006 25990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:15.282248 25990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:15.283398 25990 hybrid_clock.cc:648] HybridClock initialized: now 1786409655283382 us; error 45 us; skew 500 ppm
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:15.286054 25990 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:54:15.286494 25990 webserver.cc:460] Webserver started at http://127.26.99.129:45425/ using document root <none> and password file <none>
I20260811 00:54:15.286715 25990 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:15.286761 25990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:15.286866 25990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:15.287987 25990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "7e9be550ea9844848565c90e4ee5cfee"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "f2544701454ca2aca3c49fc02c53076e"
server_key_iv: "5059719930e6b3fefc90297f0137a7e9"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.288362 25990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "7e9be550ea9844848565c90e4ee5cfee"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "f2544701454ca2aca3c49fc02c53076e"
server_key_iv: "5059719930e6b3fefc90297f0137a7e9"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.289588 25990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:15.290342 26023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.290536 25990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:15.290625 25990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "7e9be550ea9844848565c90e4ee5cfee"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "f2544701454ca2aca3c49fc02c53076e"
server_key_iv: "5059719930e6b3fefc90297f0137a7e9"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.290696 25990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:15.310549 25990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:15.312462 25990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:15.312590 25990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:15.312820 25990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:15.313133 25990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:15.313166 25990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.313189 25990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:15.313199 25990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.318703 25990 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:35923
I20260811 00:54:15.318794 26242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:35923 every 8 connection(s)
I20260811 00:54:15.319068 25990 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:54:15.319854 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 25990
I20260811 00:54:15.319977 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:15.320184 27022 external_mini_cluster.cc:1428] Setting key d87e6d2b6f66888689eeb5ea06792d44
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:15.328555 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.319808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:57339 (local address 127.26.99.190:35253)
0811 00:54:15.319878 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.319881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.320045 (+ 164us) server_negotiation.cc:407] Connection header received
0811 00:54:15.320649 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.320651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.320667 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.320717 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:15.321721 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.322235 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.323233 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.323433 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.323488 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.325757 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:15.325758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:15.325759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:15.325767 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:15.327100 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.327570 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.327570 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.327571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.327620 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.327879 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.327879 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.327880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.327977 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:15.328024 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.328390 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.328466 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:54:15.328791 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.319752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35253 (local address 127.26.99.129:57339)
0811 00:54:15.319908 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.319951 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.320550 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.320789 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.320793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.321410 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:15.321620 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.321625 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.322326 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.322327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.323145 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.323147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.323514 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.323515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.323666 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.324150 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:15.324160 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:15.325661 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:15.327189 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.327198 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.327201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.327496 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.327678 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.327679 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.327679 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.327818 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.328035 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:15.328041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:15.328224 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.328378 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.328558 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260811 00:54:15.329248 26243 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35253
I20260811 00:54:15.329344 26243 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
I20260811 00:54:15.329524 26243 heartbeater.cc:511] Master 127.26.99.190:35253 requested a full tablet report, sending...
I20260811 00:54:15.330008 25871 ts_manager.cc:194] Registered new tserver with Master: 7e9be550ea9844848565c90e4ee5cfee (127.26.99.129:35923)
I20260811 00:54:15.330581 25871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:57339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:54:15.347594 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:15.429407 26255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:15.429616 26255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:15.429649 26255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:15.430763 26255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:15.430802 26255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:15.430837 26255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:15.432273 26255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:15.432539 26255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:15.432744 26255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:15.437609 26268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:15.437616 26269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.437681 26255 server_base.cc:1034] running on GCE node
W20260811 00:54:15.437616 26271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.437945 26255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:15.438143 26255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:15.439296 26255 hybrid_clock.cc:648] HybridClock initialized: now 1786409655439279 us; error 29 us; skew 500 ppm
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:15.441746 26255 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:54:15.442121 26255 webserver.cc:460] Webserver started at http://127.26.99.130:39821/ using document root <none> and password file <none>
I20260811 00:54:15.442308 26255 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:15.442346 26255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:15.442518 26255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:15.443608 26255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "35fcdee368934d3482c72d3efe703b4f"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "0cf7f4c2942c2b274b8119c7d733fce8"
server_key_iv: "b62a6a6356729364f4f509fdbaa0e834"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.443904 26255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "35fcdee368934d3482c72d3efe703b4f"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "0cf7f4c2942c2b274b8119c7d733fce8"
server_key_iv: "b62a6a6356729364f4f509fdbaa0e834"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.445205 26255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:15.445907 26287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.446084 26255 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:15.446165 26255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "35fcdee368934d3482c72d3efe703b4f"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "0cf7f4c2942c2b274b8119c7d733fce8"
server_key_iv: "b62a6a6356729364f4f509fdbaa0e834"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.446220 26255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:15.456525 26255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:15.458472 26255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:15.458575 26255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:15.458748 26255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:15.458997 26255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:15.459028 26255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.459048 26255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:15.459059 26255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.464586 26255 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39869
I20260811 00:54:15.464655 26519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39869 every 8 connection(s)
I20260811 00:54:15.464915 26255 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:15.473073 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 26255
I20260811 00:54:15.473196 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:15.473402 27022 external_mini_cluster.cc:1428] Setting key 26dddee8be06010d61ab33edfd19d6c2
I20260811 00:54:15.473951 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.465566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:36479 (local address 127.26.99.190:35253)
0811 00:54:15.465623 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.465624 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.465916 (+ 292us) server_negotiation.cc:407] Connection header received
0811 00:54:15.466436 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.466437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.466448 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.466504 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:15.467443 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.467964 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.469023 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.469225 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.469285 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.471160 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:15.471161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:15.471162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:15.471168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:15.472516 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.472921 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.472922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.472923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.472983 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.473276 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.473277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.473277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.473394 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:15.473458 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.473762 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.473862 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:54:15.474102 26527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.465539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35253 (local address 127.26.99.130:36479)
0811 00:54:15.465768 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.465822 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.466318 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.466558 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.466561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.467149 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:15.467343 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.467348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.468061 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.468062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.468947 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.468949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.469291 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.469291 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.469395 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.469792 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:15.469799 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:15.471074 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:15.472601 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.472607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.472609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.472835 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.473053 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.473054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.473054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.473203 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.473463 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:15.473471 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:15.473623 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.473716 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.473876 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":78,"threads_started":1}
I20260811 00:54:15.474556 26522 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35253
I20260811 00:54:15.474653 26522 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:15.474830 26522 heartbeater.cc:511] Master 127.26.99.190:35253 requested a full tablet report, sending...
I20260811 00:54:15.475162 25871 ts_manager.cc:194] Registered new tserver with Master: 35fcdee368934d3482c72d3efe703b4f (127.26.99.130:39869)
I20260811 00:54:15.475520 25871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:36479
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:54:15.499334 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:15.582195 26533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:15.582425 26533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:15.582449 26533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:15.583535 26533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:15.583566 26533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:15.583590 26533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:15.585039 26533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:15.585222 26533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:15.585398 26533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:15.590236 26543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:15.590261 26542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.590386 26533 server_base.cc:1034] running on GCE node
W20260811 00:54:15.590260 26550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:15.590617 26533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:15.590812 26533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:15.591992 26533 hybrid_clock.cc:648] HybridClock initialized: now 1786409655591969 us; error 35 us; skew 500 ppm
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:15.594583 26533 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:54:15.595019 26533 webserver.cc:460] Webserver started at http://127.26.99.131:45143/ using document root <none> and password file <none>
I20260811 00:54:15.595196 26533 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:15.595237 26533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:15.595328 26533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:15.596400 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "abbd428aa44a420bbbba20ca7c04b86a"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "cfd9213852bb28dd7cb224e6b618230b"
server_key_iv: "65836653949e73378e5a0fcc331e66b1"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.596715 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "abbd428aa44a420bbbba20ca7c04b86a"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "cfd9213852bb28dd7cb224e6b618230b"
server_key_iv: "65836653949e73378e5a0fcc331e66b1"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.597966 26533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:15.598821 26560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.599021 26533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:15.599110 26533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "abbd428aa44a420bbbba20ca7c04b86a"
format_stamp: "Formatted at 2026-08-11 00:54:15 on dist-test-slave-xt4k"
server_key: "cfd9213852bb28dd7cb224e6b618230b"
server_key_iv: "65836653949e73378e5a0fcc331e66b1"
server_key_version: "encryptionkey@0"
I20260811 00:54:15.599166 26533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:15.607594 26533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:15.609800 26533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:15.609921 26533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:15.610164 26533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:15.610499 26533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:15.610548 26533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.610576 26533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:15.610594 26533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:15.616117 26533 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38705
I20260811 00:54:15.616185 26765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38705 every 8 connection(s)
I20260811 00:54:15.616504 26533 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:54:15 dist-test-slave-xt4k krb5kdc[25794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409655, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:15.624905 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 26533
I20260811 00:54:15.624993 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:15.625054 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.617167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:36021 (local address 127.26.99.190:35253)
0811 00:54:15.617222 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.617224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.617406 (+ 182us) server_negotiation.cc:407] Connection header received
0811 00:54:15.617870 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.617871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.617881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.617931 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:15.618836 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.619346 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.620283 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.620525 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.620576 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.622668 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:15.622669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:15.622670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:15.622677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:15.623755 (+ 1078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.624126 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.624127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.624127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.624178 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.624433 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.624434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.624434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.624546 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:15.624602 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.624869 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.624953 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:54:15.625195 26769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.617156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35253 (local address 127.26.99.131:36021)
0811 00:54:15.617302 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.617337 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.617792 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.618007 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.618010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.618556 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:15.618753 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.618758 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.619415 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.619416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.620217 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.620219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.620589 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.620589 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.620694 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.621091 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:15.621098 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:15.622573 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:15.623832 (+ 1259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.623838 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.623841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.624054 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.624238 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:15.624238 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:15.624239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:15.624373 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:15.624606 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:15.624612 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:15.624744 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.624832 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.624985 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260811 00:54:15.625204 27022 external_mini_cluster.cc:1428] Setting key e5f30b12789102f756980ecc9c320921
I20260811 00:54:15.625664 26766 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35253
I20260811 00:54:15.625768 26766 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:15.625952 26766 heartbeater.cc:511] Master 127.26.99.190:35253 requested a full tablet report, sending...
I20260811 00:54:15.626294 25870 ts_manager.cc:194] Registered new tserver with Master: abbd428aa44a420bbbba20ca7c04b86a (127.26.99.131:38705)
I20260811 00:54:15.626642 25870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:36021
I20260811 00:54:15.636929 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:15.644028 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.638401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.26.99.190:35253)
0811 00:54:15.638468 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.638470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.638476 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:54:15.638495 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.638496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.638504 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.638549 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:15.639110 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.639613 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.640401 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.640610 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.640668 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.641782 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:15.641783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:15.641784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:15.641791 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:15.642979 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.643271 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.643272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.643272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.643325 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:15.643501 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:15.643502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:15.643502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:15.643651 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:15.643738 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.643863 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.643938 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:54:15.645503 25870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:15.647181 25870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:15.654224 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53950 (local address 127.26.99.130:39869)
0811 00:54:15.650051 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.650056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.650067 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:15.650108 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.650111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.650126 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.650199 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:15.650384 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651640 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653059 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.653797 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653876 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.653944 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.654093 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.654139 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":88,"threads_started":1}
I20260811 00:54:15.654234 26783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39869 (local address 127.0.0.1:53950)
0811 00:54:15.649844 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.649883 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.649951 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.650220 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.650223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.650225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:15.650296 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.650298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651770 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.651771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.652971 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.652974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.653886 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.653973 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.653989 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.654074 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.654136 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":245,"thread_start_us":44,"threads_started":1}
I20260811 00:54:15.654235 26787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38705 (local address 127.0.0.1:54650)
0811 00:54:15.650091 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.650101 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.650145 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.650407 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.650408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.650410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:15.650452 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.650453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651736 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.651737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.653111 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.653114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.653951 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.654002 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.654005 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.654068 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.654136 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":30,"thread_start_us":88,"threads_started":1}
I20260811 00:54:15.654989 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54650 (local address 127.26.99.131:38705)
0811 00:54:15.650250 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.650254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.650263 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:15.650298 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.650300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.650315 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.650521 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:15.650589 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651640 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653186 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.653871 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.653932 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.653979 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.654778 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.654904 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":120,"threads_started":1}
I20260811 00:54:15.655095 26786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35923 (local address 127.0.0.1:46540)
0811 00:54:15.650312 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.650322 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.650376 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.650658 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.650659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.650661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:15.650700 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.650701 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651695 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.651696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.653125 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.653127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.654869 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.654870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.654928 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.654932 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.654979 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.655020 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":68,"thread_start_us":88,"threads_started":1}
I20260811 00:54:15.655326 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.649957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46540 (local address 127.26.99.129:35923)
0811 00:54:15.650148 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.650153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.650435 (+ 282us) server_negotiation.cc:407] Connection header received
0811 00:54:15.650478 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.650480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.650494 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.650580 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:15.650769 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.651578 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.654014 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.654710 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.654778 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.654835 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.655191 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.655240 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":106,"threads_started":1}
I20260811 00:54:15.655352 26386 tablet_service.cc:1467] Processing CreateTablet for tablet a406c40d945c476eb27a2152dc432d97 (DEFAULT_TABLE table=test-table [id=15342fb741d841aea1e03a4022944907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:15.655740 26386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a406c40d945c476eb27a2152dc432d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:15.655926 26108 tablet_service.cc:1467] Processing CreateTablet for tablet a406c40d945c476eb27a2152dc432d97 (DEFAULT_TABLE table=test-table [id=15342fb741d841aea1e03a4022944907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:15.655930 26648 tablet_service.cc:1467] Processing CreateTablet for tablet a406c40d945c476eb27a2152dc432d97 (DEFAULT_TABLE table=test-table [id=15342fb741d841aea1e03a4022944907]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:15.656262 26108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a406c40d945c476eb27a2152dc432d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:15.656262 26648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a406c40d945c476eb27a2152dc432d97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:15.658394 26794 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Bootstrap starting.
I20260811 00:54:15.659045 26794 tablet_bootstrap.cc:654] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:15.659456 26795 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Bootstrap starting.
I20260811 00:54:15.659766 26794 log.cc:824] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:15.660137 26795 tablet_bootstrap.cc:654] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:15.660503 26796 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Bootstrap starting.
I20260811 00:54:15.660569 26794 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: No bootstrap required, opened a new log
I20260811 00:54:15.660632 26794 ts_tablet_manager.cc:1397] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:15.660662 26795 log.cc:824] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:15.661226 26796 tablet_bootstrap.cc:654] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:15.661530 26795 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: No bootstrap required, opened a new log
I20260811 00:54:15.661618 26795 ts_tablet_manager.cc:1397] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:54:15.661962 26796 log.cc:824] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:15.662511 26794 raft_consensus.cc:348] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.662667 26794 raft_consensus.cc:374] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:15.662698 26794 raft_consensus.cc:729] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35fcdee368934d3482c72d3efe703b4f, State: Initialized, Role: FOLLOWER
I20260811 00:54:15.662762 26796 tablet_bootstrap.cc:492] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: No bootstrap required, opened a new log
I20260811 00:54:15.662830 26796 ts_tablet_manager.cc:1397] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:15.662842 26794 consensus_queue.cc:260] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.663122 26794 ts_tablet_manager.cc:1428] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:54:15.663143 26522 heartbeater.cc:503] Master 127.26.99.190:35253 was elected leader, sending a full tablet report...
I20260811 00:54:15.663601 26795 raft_consensus.cc:348] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.663770 26795 raft_consensus.cc:374] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:15.663806 26795 raft_consensus.cc:729] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abbd428aa44a420bbbba20ca7c04b86a, State: Initialized, Role: FOLLOWER
I20260811 00:54:15.663957 26795 consensus_queue.cc:260] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.664234 26795 ts_tablet_manager.cc:1428] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:54:15.664263 26766 heartbeater.cc:503] Master 127.26.99.190:35253 was elected leader, sending a full tablet report...
I20260811 00:54:15.664994 26796 raft_consensus.cc:348] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.665162 26796 raft_consensus.cc:374] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:15.665207 26796 raft_consensus.cc:729] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e9be550ea9844848565c90e4ee5cfee, State: Initialized, Role: FOLLOWER
I20260811 00:54:15.665318 26796 consensus_queue.cc:260] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.665567 26796 ts_tablet_manager.cc:1428] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:54:15.665603 26243 heartbeater.cc:503] Master 127.26.99.190:35253 was elected leader, sending a full tablet report...
W20260811 00:54:15.715481 26525 tablet.cc:2369] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 00:54:15.819804 26244 tablet.cc:2369] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:54:15.821738 26804 raft_consensus.cc:482] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:15.821838 26804 raft_consensus.cc:504] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.822139 26804 leader_election.cc:288] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35fcdee368934d3482c72d3efe703b4f (127.26.99.130:39869), 7e9be550ea9844848565c90e4ee5cfee (127.26.99.129:35923)
I20260811 00:54:15.825053 26793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.822429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:44461 (local address 127.26.99.129:35923)
0811 00:54:15.822476 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.822478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.822634 (+ 156us) server_negotiation.cc:407] Connection header received
0811 00:54:15.822683 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.822684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.822694 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.822756 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:15.822954 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.823436 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824363 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.824736 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824805 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.824813 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.824951 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.824984 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:54:15.825059 26790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.822447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:58797 (local address 127.26.99.130:39869)
0811 00:54:15.822488 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.822490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.822499 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:15.822539 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.822540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.822557 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.822632 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:15.822831 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.823360 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824288 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.824719 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824777 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.824786 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.824953 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.824991 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:54:15.825101 26769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.822354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39869 (local address 127.26.99.131:58797)
0811 00:54:15.822430 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.822442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.822488 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.822646 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.822647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.822649 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:15.822730 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.822732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.823440 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.823441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.824196 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.824198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.824796 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.824882 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.824885 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.824934 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.824977 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":2}
I20260811 00:54:15.825110 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.822352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35923 (local address 127.26.99.131:44461)
0811 00:54:15.822554 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.822565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:15.822630 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:15.822798 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:15.822799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:15.822802 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:15.822879 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.822881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.823513 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.823514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.824257 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:15.824259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.824822 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.824823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:15.824881 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.824885 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:15.824932 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:54:15.824971 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":15,"thread_start_us":115,"threads_started":1}
I20260811 00:54:15.825465 26429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a406c40d945c476eb27a2152dc432d97" candidate_uuid: "abbd428aa44a420bbbba20ca7c04b86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35fcdee368934d3482c72d3efe703b4f" is_pre_election: true
I20260811 00:54:15.825492 26145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a406c40d945c476eb27a2152dc432d97" candidate_uuid: "abbd428aa44a420bbbba20ca7c04b86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9be550ea9844848565c90e4ee5cfee" is_pre_election: true
I20260811 00:54:15.825631 26145 raft_consensus.cc:2454] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abbd428aa44a420bbbba20ca7c04b86a in term 0.
I20260811 00:54:15.825631 26429 raft_consensus.cc:2454] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abbd428aa44a420bbbba20ca7c04b86a in term 0.
I20260811 00:54:15.825861 26568 leader_election.cc:302] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e9be550ea9844848565c90e4ee5cfee, abbd428aa44a420bbbba20ca7c04b86a; no voters:
I20260811 00:54:15.826030 26804 raft_consensus.cc:2781] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:15.826071 26804 raft_consensus.cc:482] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:15.826084 26804 raft_consensus.cc:3037] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:15.826730 26804 raft_consensus.cc:504] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.826848 26804 leader_election.cc:288] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [CANDIDATE]: Term 1 election: Requested vote from peers 35fcdee368934d3482c72d3efe703b4f (127.26.99.130:39869), 7e9be550ea9844848565c90e4ee5cfee (127.26.99.129:35923)
I20260811 00:54:15.826992 26145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a406c40d945c476eb27a2152dc432d97" candidate_uuid: "abbd428aa44a420bbbba20ca7c04b86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e9be550ea9844848565c90e4ee5cfee"
I20260811 00:54:15.826996 26429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a406c40d945c476eb27a2152dc432d97" candidate_uuid: "abbd428aa44a420bbbba20ca7c04b86a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35fcdee368934d3482c72d3efe703b4f"
I20260811 00:54:15.827069 26429 raft_consensus.cc:3037] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:15.827070 26145 raft_consensus.cc:3037] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:15.827775 26429 raft_consensus.cc:2454] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abbd428aa44a420bbbba20ca7c04b86a in term 1.
I20260811 00:54:15.827780 26145 raft_consensus.cc:2454] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abbd428aa44a420bbbba20ca7c04b86a in term 1.
I20260811 00:54:15.827948 26564 leader_election.cc:302] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 35fcdee368934d3482c72d3efe703b4f, 7e9be550ea9844848565c90e4ee5cfee, abbd428aa44a420bbbba20ca7c04b86a; no voters:
I20260811 00:54:15.828070 26804 raft_consensus.cc:2781] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:15.828238 26804 raft_consensus.cc:686] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 1 LEADER]: Becoming Leader. State: Replica: abbd428aa44a420bbbba20ca7c04b86a, State: Running, Role: LEADER
I20260811 00:54:15.828326 26804 consensus_queue.cc:237] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } }
I20260811 00:54:15.829208 25871 catalog_manager.cc:5495] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a reported cstate change: term changed from 0 to 1, leader changed from <none> to abbd428aa44a420bbbba20ca7c04b86a (127.26.99.131). New cstate: current_term: 1 leader_uuid: "abbd428aa44a420bbbba20ca7c04b86a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abbd428aa44a420bbbba20ca7c04b86a" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20260811 00:54:15.836671 26791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.834576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.26.99.131:38705)
0811 00:54:15.834630 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:15.834632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:15.834656 (+ 24us) server_negotiation.cc:407] Connection header received
0811 00:54:15.834725 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:15.834726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:15.834741 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:15.834794 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:15.834873 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.835316 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.836008 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:15.836199 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:15.836251 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:15.836380 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:15.836498 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:15.836558 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:15.836589 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 00:54:15.836606 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:54:15.838464 26145 raft_consensus.cc:1261] T a406c40d945c476eb27a2152dc432d97 P 7e9be550ea9844848565c90e4ee5cfee [term 1 FOLLOWER]: Refusing update from remote peer abbd428aa44a420bbbba20ca7c04b86a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:15.838515 26429 raft_consensus.cc:1261] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 1 FOLLOWER]: Refusing update from remote peer abbd428aa44a420bbbba20ca7c04b86a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:15.838778 26804 consensus_queue.cc:1035] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e9be550ea9844848565c90e4ee5cfee" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:15.838913 26808 consensus_queue.cc:1035] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35fcdee368934d3482c72d3efe703b4f" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:15.842007 26815 mvcc.cc:205] Tried to move back new op lower bound from 7317133950311677952 to 7317133950273568768. Current Snapshot: MvccSnapshot[applied={T|T < 7317133950311677952 or (T in {7317133950311677952})}]
I20260811 00:54:15.843655 25870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:15.843755 25870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:15.844506 25870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 95deb7db1b6f4c08bd169e265a9bcdef: Sending DeleteTablet for 3 replicas of tablet a406c40d945c476eb27a2152dc432d97
I20260811 00:54:15.844815 26386 tablet_service.cc:1514] Processing DeleteTablet for tablet a406c40d945c476eb27a2152dc432d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:15 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:53950
I20260811 00:54:15.844830 26108 tablet_service.cc:1514] Processing DeleteTablet for tablet a406c40d945c476eb27a2152dc432d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:15 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:46540
I20260811 00:54:15.844834 26648 tablet_service.cc:1514] Processing DeleteTablet for tablet a406c40d945c476eb27a2152dc432d97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:15 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:54650
I20260811 00:54:15.845112 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 25990
I20260811 00:54:15.856642 26843 tablet_replica.cc:330] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: stopping tablet replica
I20260811 00:54:15.856814 26843 raft_consensus.cc:2229] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:15.856958 26843 raft_consensus.cc:2258] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:15.857158 26841 tablet_replica.cc:330] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: stopping tablet replica
I20260811 00:54:15.858099 26841 raft_consensus.cc:2229] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:54:15.858287 26841 raft_consensus.cc:2258] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:15.858435 26843 ts_tablet_manager.cc:1905] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:15.858814 26841 ts_tablet_manager.cc:1905] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:15.860232 26843 ts_tablet_manager.cc:1918] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:15.860410 26843 log.cc:1196] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/a406c40d945c476eb27a2152dc432d97
I20260811 00:54:15.860536 26841 ts_tablet_manager.cc:1918] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:15.860692 26841 log.cc:1196] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/a406c40d945c476eb27a2152dc432d97
I20260811 00:54:15.860787 26843 ts_tablet_manager.cc:1939] T a406c40d945c476eb27a2152dc432d97 P 35fcdee368934d3482c72d3efe703b4f: Deleting consensus metadata
I20260811 00:54:15.861034 26841 ts_tablet_manager.cc:1939] T a406c40d945c476eb27a2152dc432d97 P abbd428aa44a420bbbba20ca7c04b86a: Deleting consensus metadata
I20260811 00:54:15.861392 25847 catalog_manager.cc:4841] TS 35fcdee368934d3482c72d3efe703b4f (127.26.99.130:39869): tablet a406c40d945c476eb27a2152dc432d97 (table test-table [id=15342fb741d841aea1e03a4022944907]) successfully deleted
I20260811 00:54:15.861505 25842 catalog_manager.cc:4841] TS abbd428aa44a420bbbba20ca7c04b86a (127.26.99.131:38705): tablet a406c40d945c476eb27a2152dc432d97 (table test-table [id=15342fb741d841aea1e03a4022944907]) successfully deleted
W20260811 00:54:15.863211 25850 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:35923 (error 108)
I20260811 00:54:15.863469 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 26255
I20260811 00:54:15.869521 26786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:15.863602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35923 (local address 127.0.0.1:46550)
0811 00:54:15.869403 (+ 5801us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:15.869476 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:35923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5771}
W20260811 00:54:15.873723 25850 catalog_manager.cc:4584] TS 7e9be550ea9844848565c90e4ee5cfee (127.26.99.129:35923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a406c40d945c476eb27a2152dc432d97: Network error: Client connection negotiation failed: client connection to 127.26.99.129:35923: connect: Connection refused (error 111)
I20260811 00:54:15.886147 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 26533
I20260811 00:54:15.897454 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 25816
2026-08-11T00:54:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2294 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T00:54:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:15Z Disabled control of system clock
I20260811 00:54:15.935817 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44855
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:36745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:44855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:16.016806 26853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:16.017030 26853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:16.017050 26853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:16.018225 26853 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:16.018266 26853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:16.018278 26853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:16.018289 26853 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:16.018301 26853 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:16.019863 26853 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:44855
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:44855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:16.020112 26853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:16.020426 26853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:16.025327 26863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.025375 26853 server_base.cc:1034] running on GCE node
W20260811 00:54:16.025336 26860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:16.025336 26867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.025729 26853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:16.026000 26853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:16.027149 26853 hybrid_clock.cc:648] HybridClock initialized: now 1786409656027125 us; error 40 us; skew 500 ppm
I20260811 00:54:16.028501 26853 webserver.cc:460] Webserver started at http://127.26.99.190:32909/ using document root <none> and password file <none>
I20260811 00:54:16.028739 26853 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:16.028790 26853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:16.028920 26853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:16.030025 26853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "0a0b4fedc6c64acf8c81d7cd3731c716"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "b9161371ef158849afd8a7a257e1944c"
server_key_iv: "8f100626af71aa5518678224b153b3d7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.030361 26853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "0a0b4fedc6c64acf8c81d7cd3731c716"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "b9161371ef158849afd8a7a257e1944c"
server_key_iv: "8f100626af71aa5518678224b153b3d7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.031656 26853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:16.032428 26875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.032572 26853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:16.032660 26853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "0a0b4fedc6c64acf8c81d7cd3731c716"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "b9161371ef158849afd8a7a257e1944c"
server_key_iv: "8f100626af71aa5518678224b153b3d7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.032728 26853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:16.050446 26853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:16.050729 26853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:16.050850 26853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:16.054822 26853 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:44855
I20260811 00:54:16.054862 26965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:44855 every 8 connection(s)
I20260811 00:54:16.055176 26853 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:16.056154 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:16.058418 26967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: Bootstrap starting.
I20260811 00:54:16.058984 26967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:16.059247 26967 log.cc:824] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:16.059878 26967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: No bootstrap required, opened a new log
I20260811 00:54:16.060357 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 26853
I20260811 00:54:16.060467 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:16.060680 27022 external_mini_cluster.cc:1428] Setting key 933c395bc53fa26385f28d887dcbbe66
I20260811 00:54:16.061960 26967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } }
I20260811 00:54:16.062124 26967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:16.062162 26967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0b4fedc6c64acf8c81d7cd3731c716, State: Initialized, Role: FOLLOWER
I20260811 00:54:16.062337 26967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } }
I20260811 00:54:16.062448 26967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:16.062489 26967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:16.062541 26967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:16.063191 26967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } }
I20260811 00:54:16.063299 26967 leader_election.cc:302] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a0b4fedc6c64acf8c81d7cd3731c716; no voters:
I20260811 00:54:16.063452 26967 leader_election.cc:288] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:16.063499 26978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:16.063632 26978 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0b4fedc6c64acf8c81d7cd3731c716, State: Running, Role: LEADER
I20260811 00:54:16.063689 26967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:16.063758 26978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } }
I20260811 00:54:16.064145 26981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } } }
I20260811 00:54:16.064159 26979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a0b4fedc6c64acf8c81d7cd3731c716. Latest consensus state: current_term: 1 leader_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a0b4fedc6c64acf8c81d7cd3731c716" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 44855 } } }
I20260811 00:54:16.064392 26979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:16.064282 26981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:16.065223 27002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:16.065701 27002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:16.067080 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.061158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.26.99.190:44855)
0811 00:54:16.061402 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.061411 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.061445 (+ 34us) server_negotiation.cc:407] Connection header received
0811 00:54:16.061891 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.061901 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.061975 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.062131 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:16.062301 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.063917 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.064982 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.065575 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.065698 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.066405 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:16.066408 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:16.066409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:16.066615 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:16.066656 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:16.066670 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:16.066735 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.066830 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.066906 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260811 00:54:16.067628 27002 catalog_manager.cc:1347] Generated new cluster ID: e133fc93ab9e4f85a047211586c57043
I20260811 00:54:16.067677 27002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:16.078217 27002 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:16.078744 27002 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:16.083777 27002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: Generated new TSK 0
I20260811 00:54:16.083953 27002 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:16.087811 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--builtin_ntp_servers=127.26.99.148:36745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:16.170919 27015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:16.171115 27015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:16.171135 27015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:16.172278 27015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:16.172317 27015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:16.172369 27015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:16.173974 27015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:16.174213 27015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:16.174521 27015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:16.179359 27020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:16.179354 27029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.179553 27015 server_base.cc:1034] running on GCE node
W20260811 00:54:16.179610 27032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.179824 27015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:16.180094 27015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:16.181267 27015 hybrid_clock.cc:648] HybridClock initialized: now 1786409656181244 us; error 34 us; skew 500 ppm
I20260811 00:54:16.182773 27015 webserver.cc:460] Webserver started at http://127.26.99.129:37135/ using document root <none> and password file <none>
I20260811 00:54:16.183058 27015 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:16.183111 27015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:16.183236 27015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:16.184561 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "b4190cfed51c43a7a209a768d3e4e082"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "8009edd88d8cf1f12c3d92c51e9eb197"
server_key_iv: "d8a5698bb5bbc8a437317ad1ca1035c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.185022 27015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "b4190cfed51c43a7a209a768d3e4e082"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "8009edd88d8cf1f12c3d92c51e9eb197"
server_key_iv: "d8a5698bb5bbc8a437317ad1ca1035c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.186597 27015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:16.187451 27042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.187631 27015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:16.187728 27015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "b4190cfed51c43a7a209a768d3e4e082"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "8009edd88d8cf1f12c3d92c51e9eb197"
server_key_iv: "d8a5698bb5bbc8a437317ad1ca1035c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.187808 27015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:16.198684 27015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:16.198953 27015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:16.199062 27015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:16.199256 27015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:16.199527 27015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:16.199558 27015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.199584 27015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:16.199600 27015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.205391 27015 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:42773
I20260811 00:54:16.205426 27248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:42773 every 8 connection(s)
I20260811 00:54:16.205758 27015 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:54:16.210842 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.206433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:60973 (local address 127.26.99.190:44855)
0811 00:54:16.206474 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.206477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.206720 (+ 243us) server_negotiation.cc:407] Connection header received
0811 00:54:16.207179 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.207180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.207191 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.207238 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:16.207906 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.208505 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.209475 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.209678 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.209741 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.210607 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:16.210609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:16.210609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:16.210613 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:16.210628 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:16.210632 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:16.210685 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.210752 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.210779 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:54:16.211040 27253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.206409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:44855 (local address 127.26.99.129:60973)
0811 00:54:16.206585 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.206619 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.207092 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.207298 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.207301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.207309 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:16.207814 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.207818 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.208596 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.208597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.209386 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.209388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.209786 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.209788 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.209916 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.210453 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:16.210454 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:16.210484 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:16.210508 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:16.210694 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:16.210697 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:16.210699 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.210745 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.210827 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260811 00:54:16.211520 27249 heartbeater.cc:347] Connected to a master server at 127.26.99.190:44855
I20260811 00:54:16.211613 27249 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:16.211788 27249 heartbeater.cc:511] Master 127.26.99.190:44855 requested a full tablet report, sending...
I20260811 00:54:16.212291 26910 ts_manager.cc:194] Registered new tserver with Master: b4190cfed51c43a7a209a768d3e4e082 (127.26.99.129:42773)
I20260811 00:54:16.212920 26910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.129:60973
I20260811 00:54:16.213551 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27015
I20260811 00:54:16.213646 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:16.213810 27022 external_mini_cluster.cc:1428] Setting key aa23c7f2a7a6dbdb0617b8ef34b49bbd
I20260811 00:54:16.214641 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--builtin_ntp_servers=127.26.99.148:36745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:16.298594 27255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:16.298802 27255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:16.298830 27255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:16.299949 27255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:16.299995 27255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:16.300028 27255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:16.301403 27255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:16.301645 27255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:16.301935 27255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:16.307000 27261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:16.307009 27267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:16.307011 27263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.307237 27255 server_base.cc:1034] running on GCE node
I20260811 00:54:16.307473 27255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:16.307724 27255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:16.308897 27255 hybrid_clock.cc:648] HybridClock initialized: now 1786409656308881 us; error 30 us; skew 500 ppm
I20260811 00:54:16.310285 27255 webserver.cc:460] Webserver started at http://127.26.99.130:35397/ using document root <none> and password file <none>
I20260811 00:54:16.310532 27255 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:16.310586 27255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:16.310717 27255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:16.311780 27255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "5d1331033a6e4354a9323a0c587a4aa4"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "64d7fba355f3234a5a20d1a261750a28"
server_key_iv: "1afd8f45ce35de4e2e2d81ccfead7ec2"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.312119 27255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "5d1331033a6e4354a9323a0c587a4aa4"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "64d7fba355f3234a5a20d1a261750a28"
server_key_iv: "1afd8f45ce35de4e2e2d81ccfead7ec2"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.313405 27255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:16.314111 27277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.314276 27255 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:16.314370 27255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "5d1331033a6e4354a9323a0c587a4aa4"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "64d7fba355f3234a5a20d1a261750a28"
server_key_iv: "1afd8f45ce35de4e2e2d81ccfead7ec2"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.314440 27255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:16.328329 27255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:16.328675 27255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:16.328805 27255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:16.329037 27255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:16.329348 27255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:16.329383 27255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.329414 27255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:16.329438 27255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.334889 27255 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39333
I20260811 00:54:16.334965 27459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39333 every 8 connection(s)
I20260811 00:54:16.335268 27255 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:54:16.340255 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.335970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:43181 (local address 127.26.99.190:44855)
0811 00:54:16.336025 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.336027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.336256 (+ 229us) server_negotiation.cc:407] Connection header received
0811 00:54:16.336813 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.336815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.336826 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.336881 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:16.337495 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.338001 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.339007 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.339219 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.339284 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.340037 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:16.340038 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:16.340039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:16.340043 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:16.340058 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:16.340062 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:16.340105 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.340174 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.340195 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:54:16.340510 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27255
I20260811 00:54:16.340538 27463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.335946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:44855 (local address 127.26.99.130:43181)
0811 00:54:16.336139 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.336171 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.336701 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.336934 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.336937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.336945 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:16.337433 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.337437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.338081 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.338082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.338904 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.338906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.339302 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.339303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.339419 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.339895 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:16.339896 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:16.339925 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:16.339948 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:16.340116 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:16.340118 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:16.340121 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.340168 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.340275 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
I20260811 00:54:16.340636 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:16.340840 27022 external_mini_cluster.cc:1428] Setting key 4efdd1897fd90960700afb884b5f2002
I20260811 00:54:16.340997 27460 heartbeater.cc:347] Connected to a master server at 127.26.99.190:44855
I20260811 00:54:16.341105 27460 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:16.341334 27460 heartbeater.cc:511] Master 127.26.99.190:44855 requested a full tablet report, sending...
I20260811 00:54:16.341749 26910 ts_manager.cc:194] Registered new tserver with Master: 5d1331033a6e4354a9323a0c587a4aa4 (127.26.99.130:39333)
I20260811 00:54:16.341851 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--builtin_ntp_servers=127.26.99.148:36745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:54:16.342178 26910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.130:43181
W20260811 00:54:16.424104 27466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:16.424294 27466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:16.424314 27466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:16.425480 27466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:16.425519 27466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:16.425542 27466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:16.426893 27466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:44855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:16.427124 27466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:16.427414 27466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:16.432220 27473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:16.432250 27480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.432415 27466 server_base.cc:1034] running on GCE node
W20260811 00:54:16.432235 27474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:16.432713 27466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:16.432914 27466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:16.434073 27466 hybrid_clock.cc:648] HybridClock initialized: now 1786409656434057 us; error 27 us; skew 500 ppm
I20260811 00:54:16.435282 27466 webserver.cc:460] Webserver started at http://127.26.99.131:38741/ using document root <none> and password file <none>
I20260811 00:54:16.435513 27466 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:16.435556 27466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:16.435671 27466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:16.436734 27466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "f6de2db0f8984f368e5676c68cea2213"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "288fde96f18605c0fa3d67d4e880f2d1"
server_key_iv: "319a04a8c24f1454a0ed4b4d825ffebb"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.437075 27466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "f6de2db0f8984f368e5676c68cea2213"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "288fde96f18605c0fa3d67d4e880f2d1"
server_key_iv: "319a04a8c24f1454a0ed4b4d825ffebb"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.438294 27466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:16.438897 27492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.439050 27466 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:16.439133 27466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "f6de2db0f8984f368e5676c68cea2213"
format_stamp: "Formatted at 2026-08-11 00:54:16 on dist-test-slave-xt4k"
server_key: "288fde96f18605c0fa3d67d4e880f2d1"
server_key_iv: "319a04a8c24f1454a0ed4b4d825ffebb"
server_key_version: "encryptionkey@0"
I20260811 00:54:16.439194 27466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:16.457036 27466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:16.457345 27466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:16.457482 27466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:16.457701 27466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:16.458035 27466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:16.458071 27466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.458101 27466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:16.458118 27466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:16.463829 27466 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:39835
I20260811 00:54:16.463867 27683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:39835 every 8 connection(s)
I20260811 00:54:16.464241 27466 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:54:16.467469 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27466
I20260811 00:54:16.467590 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:16.467794 27022 external_mini_cluster.cc:1428] Setting key 02a5f4bcdbac2fead0174dfec2aad8fb
I20260811 00:54:16.469666 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.464991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:32903 (local address 127.26.99.190:44855)
0811 00:54:16.465047 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.465049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.465306 (+ 257us) server_negotiation.cc:407] Connection header received
0811 00:54:16.465838 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.465839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.465851 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.465904 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:16.466587 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.467085 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.468366 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.468568 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.468625 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.469404 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:16.469406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:16.469406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:16.469410 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:16.469427 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:16.469431 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:16.469477 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.469557 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.469586 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:54:16.469866 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.464992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:44855 (local address 127.26.99.131:32903)
0811 00:54:16.465187 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.465220 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.465736 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.465975 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.465979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.465987 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:16.466492 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.466498 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.467176 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.467177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.468272 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.468275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.468639 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.468640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.468779 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.469271 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:16.469271 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:16.469300 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:16.469324 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:16.469485 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:16.469490 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:16.469493 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.469549 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.469651 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260811 00:54:16.470319 27684 heartbeater.cc:347] Connected to a master server at 127.26.99.190:44855
I20260811 00:54:16.470394 27684 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:16.470566 27684 heartbeater.cc:511] Master 127.26.99.190:44855 requested a full tablet report, sending...
I20260811 00:54:16.470896 26910 ts_manager.cc:194] Registered new tserver with Master: f6de2db0f8984f368e5676c68cea2213 (127.26.99.131:39835)
I20260811 00:54:16.471239 26910 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.131:32903
I20260811 00:54:16.479811 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:16.483875 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.481227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51754 (local address 127.26.99.190:44855)
0811 00:54:16.481282 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.481284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.481385 (+ 101us) server_negotiation.cc:407] Connection header received
0811 00:54:16.481439 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.481440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.481449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.481485 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:16.481614 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.482093 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.482820 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.483012 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.483068 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.483677 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:16.483678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:16.483678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:16.483682 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:16.483696 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:16.483700 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:16.483737 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.483781 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.483801 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:54:16.485352 26910 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51754:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:16.486896 26910 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:16.493185 27701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.488935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39333 (local address 127.0.0.1:33398)
0811 00:54:16.489053 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.489093 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.489160 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.489688 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.489691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.489694 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:16.489758 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.489760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.491076 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.491077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.492174 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.492176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.492905 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.492984 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.492997 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.493062 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.493113 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":65,"threads_started":1}
I20260811 00:54:16.493197 27704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.489039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33398 (local address 127.26.99.130:39333)
0811 00:54:16.489525 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.489529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.489538 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:16.489573 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.489575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.489588 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.489675 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:16.489849 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.490996 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492249 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.492832 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492896 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.492990 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.493075 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.493113 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":96,"threads_started":1}
I20260811 00:54:16.493305 27707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.489106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:39835 (local address 127.0.0.1:35662)
0811 00:54:16.489385 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.489394 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.489440 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.489749 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.489750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.489752 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:16.489798 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.489799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.490684 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.490685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.491994 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.491997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.493047 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.493047 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.493129 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.493136 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.493185 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.493226 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":7,"thread_start_us":75,"threads_started":1}
I20260811 00:54:16.493453 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.489262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:42773 (local address 127.0.0.1:57576)
0811 00:54:16.489529 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.489536 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.489581 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.489923 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.489924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.489926 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:16.489955 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.489956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.491129 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.491130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.492021 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.492024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.493045 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.493046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.493129 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.493137 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.493185 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.493226 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":26,"thread_start_us":67,"threads_started":1}
I20260811 00:54:16.493546 27708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.489242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.26.99.131:39835)
0811 00:54:16.489430 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.489434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.489443 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:16.489540 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.489542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.489623 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.489688 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:16.489870 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.490603 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492091 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.492857 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492922 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.493008 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.493420 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.493463 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
I20260811 00:54:16.493746 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.489394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57576 (local address 127.26.99.129:42773)
0811 00:54:16.489769 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.489779 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.489789 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:16.489834 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.489836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.489851 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.489925 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:16.490013 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.491064 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492106 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.492854 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.492922 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.493008 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.493645 (+ 637us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.493689 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
I20260811 00:54:16.493882 27356 tablet_service.cc:1467] Processing CreateTablet for tablet e5c5757226c74522b7760c8eb3a69020 (DEFAULT_TABLE table=test-table [id=311723c2e8694f2fa5d0490633f88aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:16.494280 27356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c5757226c74522b7760c8eb3a69020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:16.494326 27135 tablet_service.cc:1467] Processing CreateTablet for tablet e5c5757226c74522b7760c8eb3a69020 (DEFAULT_TABLE table=test-table [id=311723c2e8694f2fa5d0490633f88aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:16.494640 27135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c5757226c74522b7760c8eb3a69020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:16.496827 27711 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Bootstrap starting.
I20260811 00:54:16.497092 27713 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: Bootstrap starting.
I20260811 00:54:16.497502 27580 tablet_service.cc:1467] Processing CreateTablet for tablet e5c5757226c74522b7760c8eb3a69020 (DEFAULT_TABLE table=test-table [id=311723c2e8694f2fa5d0490633f88aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:16.497650 27711 tablet_bootstrap.cc:654] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:16.497838 27580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c5757226c74522b7760c8eb3a69020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:16.497941 27713 tablet_bootstrap.cc:654] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:16.497929 27711 log.cc:824] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:16.498261 27713 log.cc:824] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:16.498631 27711 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: No bootstrap required, opened a new log
I20260811 00:54:16.498705 27711 ts_tablet_manager.cc:1397] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:16.499070 27713 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: No bootstrap required, opened a new log
I20260811 00:54:16.499143 27713 ts_tablet_manager.cc:1397] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:16.500588 27711 raft_consensus.cc:348] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.500756 27711 raft_consensus.cc:374] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:16.500792 27711 raft_consensus.cc:729] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1331033a6e4354a9323a0c587a4aa4, State: Initialized, Role: FOLLOWER
I20260811 00:54:16.500923 27711 consensus_queue.cc:260] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.501174 27711 ts_tablet_manager.cc:1428] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:54:16.501324 27460 heartbeater.cc:503] Master 127.26.99.190:44855 was elected leader, sending a full tablet report...
I20260811 00:54:16.501627 27713 raft_consensus.cc:348] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.501783 27713 raft_consensus.cc:374] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:16.501811 27713 raft_consensus.cc:729] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4190cfed51c43a7a209a768d3e4e082, State: Initialized, Role: FOLLOWER
I20260811 00:54:16.501915 27713 consensus_queue.cc:260] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.502141 27713 ts_tablet_manager.cc:1428] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 00:54:16.502275 27249 heartbeater.cc:503] Master 127.26.99.190:44855 was elected leader, sending a full tablet report...
I20260811 00:54:16.502410 27722 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Bootstrap starting.
I20260811 00:54:16.503098 27722 tablet_bootstrap.cc:654] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:16.503408 27722 log.cc:824] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:16.504042 27722 tablet_bootstrap.cc:492] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: No bootstrap required, opened a new log
I20260811 00:54:16.504105 27722 ts_tablet_manager.cc:1397] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:16.505903 27722 raft_consensus.cc:348] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.506021 27722 raft_consensus.cc:374] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:16.506040 27722 raft_consensus.cc:729] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6de2db0f8984f368e5676c68cea2213, State: Initialized, Role: FOLLOWER
I20260811 00:54:16.506125 27722 consensus_queue.cc:260] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.506300 27722 ts_tablet_manager.cc:1428] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:54:16.506363 27684 heartbeater.cc:503] Master 127.26.99.190:44855 was elected leader, sending a full tablet report...
I20260811 00:54:16.517478 27728 raft_consensus.cc:482] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:16.517589 27728 raft_consensus.cc:504] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.518009 27728 leader_election.cc:288] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d1331033a6e4354a9323a0c587a4aa4 (127.26.99.130:39333), b4190cfed51c43a7a209a768d3e4e082 (127.26.99.129:42773)
I20260811 00:54:16.521970 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.518414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:35921 (local address 127.26.99.129:42773)
0811 00:54:16.518461 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.518462 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.518651 (+ 189us) server_negotiation.cc:407] Connection header received
0811 00:54:16.518685 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.518686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.518699 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.518773 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:16.518948 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.519593 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.521032 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.521588 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.521664 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.521673 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.521857 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.521896 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:54:16.521970 27704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.518319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:52491 (local address 127.26.99.130:39333)
0811 00:54:16.518385 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.518387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.518398 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:16.518430 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.518430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.518439 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.518501 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:16.518689 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.519443 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.520989 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.521574 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.521664 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.521673 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.521857 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.521896 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:54:16.521986 27686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.518241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39333 (local address 127.26.99.131:52491)
0811 00:54:16.518300 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.518311 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.518363 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.518505 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.518506 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.518508 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:16.518590 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.518592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.519620 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.519622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.520871 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.520874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.521679 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.521681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.521782 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.521789 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.521846 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.521899 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":31}
I20260811 00:54:16.522006 27729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.518354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:42773 (local address 127.26.99.131:35921)
0811 00:54:16.518533 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.518542 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:16.518621 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:16.518804 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:16.518805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:16.518807 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:16.518875 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.518876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.519669 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.519670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.520871 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:16.520874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.521680 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.521681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:16.521783 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.521789 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:54:16.521845 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 00:54:16.521897 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":24,"thread_start_us":109,"threads_started":1}
I20260811 00:54:16.522330 27385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c5757226c74522b7760c8eb3a69020" candidate_uuid: "f6de2db0f8984f368e5676c68cea2213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1331033a6e4354a9323a0c587a4aa4" is_pre_election: true
I20260811 00:54:16.522495 27385 raft_consensus.cc:2454] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6de2db0f8984f368e5676c68cea2213 in term 0.
I20260811 00:54:16.522719 27493 leader_election.cc:302] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1331033a6e4354a9323a0c587a4aa4, f6de2db0f8984f368e5676c68cea2213; no voters:
I20260811 00:54:16.522841 27728 raft_consensus.cc:2781] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:16.522890 27728 raft_consensus.cc:482] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:16.522913 27728 raft_consensus.cc:3037] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:16.522883 27172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c5757226c74522b7760c8eb3a69020" candidate_uuid: "f6de2db0f8984f368e5676c68cea2213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4190cfed51c43a7a209a768d3e4e082" is_pre_election: true
I20260811 00:54:16.523049 27172 raft_consensus.cc:2454] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6de2db0f8984f368e5676c68cea2213 in term 0.
I20260811 00:54:16.523699 27728 raft_consensus.cc:504] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.523823 27728 leader_election.cc:288] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [CANDIDATE]: Term 1 election: Requested vote from peers 5d1331033a6e4354a9323a0c587a4aa4 (127.26.99.130:39333), b4190cfed51c43a7a209a768d3e4e082 (127.26.99.129:42773)
I20260811 00:54:16.524020 27385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c5757226c74522b7760c8eb3a69020" candidate_uuid: "f6de2db0f8984f368e5676c68cea2213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1331033a6e4354a9323a0c587a4aa4"
I20260811 00:54:16.524032 27172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c5757226c74522b7760c8eb3a69020" candidate_uuid: "f6de2db0f8984f368e5676c68cea2213" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4190cfed51c43a7a209a768d3e4e082"
I20260811 00:54:16.524097 27172 raft_consensus.cc:3037] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:16.524096 27385 raft_consensus.cc:3037] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:16.524966 27172 raft_consensus.cc:2454] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6de2db0f8984f368e5676c68cea2213 in term 1.
I20260811 00:54:16.524986 27385 raft_consensus.cc:2454] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6de2db0f8984f368e5676c68cea2213 in term 1.
I20260811 00:54:16.525142 27493 leader_election.cc:302] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4190cfed51c43a7a209a768d3e4e082, f6de2db0f8984f368e5676c68cea2213; no voters:
I20260811 00:54:16.525226 27728 raft_consensus.cc:2781] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:16.525393 27728 raft_consensus.cc:686] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 1 LEADER]: Becoming Leader. State: Replica: f6de2db0f8984f368e5676c68cea2213, State: Running, Role: LEADER
I20260811 00:54:16.525490 27728 consensus_queue.cc:237] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } }
I20260811 00:54:16.526351 26910 catalog_manager.cc:5495] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6de2db0f8984f368e5676c68cea2213 (127.26.99.131). New cstate: current_term: 1 leader_uuid: "f6de2db0f8984f368e5676c68cea2213" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6de2db0f8984f368e5676c68cea2213" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 39835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 } health_report { overall_health: UNKNOWN } } }
I20260811 00:54:16.538574 27708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.536328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.26.99.131:39835)
0811 00:54:16.536392 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:16.536393 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:16.536403 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:16.536476 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:16.536477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:16.536504 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:16.536561 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:16.536682 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.537155 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.537875 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:16.538061 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:16.538116 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:16.538259 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:16.538355 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:16.538426 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:16.538463 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 00:54:16.538481 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:54:16.540855 27172 raft_consensus.cc:1261] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 1 FOLLOWER]: Refusing update from remote peer f6de2db0f8984f368e5676c68cea2213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:16.540855 27385 raft_consensus.cc:1261] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 1 FOLLOWER]: Refusing update from remote peer f6de2db0f8984f368e5676c68cea2213: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:16.541214 27730 consensus_queue.cc:1035] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4190cfed51c43a7a209a768d3e4e082" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:16.541352 27728 consensus_queue.cc:1035] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1331033a6e4354a9323a0c587a4aa4" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:16.544067 27737 mvcc.cc:205] Tried to move back new op lower bound from 7317133953188560896 to 7317133953129140224. Current Snapshot: MvccSnapshot[applied={T|T < 7317133953188560896 or (T in {7317133953188560896})}]
I20260811 00:54:16.544557 27736 mvcc.cc:205] Tried to move back new op lower bound from 7317133953188560896 to 7317133953129140224. Current Snapshot: MvccSnapshot[applied={T|T < 7317133953188560896}]
I20260811 00:54:16.545840 26909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:16.545931 26909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:16.546682 26909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a0b4fedc6c64acf8c81d7cd3731c716: Sending DeleteTablet for 3 replicas of tablet e5c5757226c74522b7760c8eb3a69020
I20260811 00:54:16.547003 27356 tablet_service.cc:1514] Processing DeleteTablet for tablet e5c5757226c74522b7760c8eb3a69020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:16 UTC) from {username='slave'} at 127.0.0.1:33398
I20260811 00:54:16.547083 27135 tablet_service.cc:1514] Processing DeleteTablet for tablet e5c5757226c74522b7760c8eb3a69020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:16 UTC) from {username='slave'} at 127.0.0.1:57576
I20260811 00:54:16.547263 27753 tablet_replica.cc:330] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082: stopping tablet replica
I20260811 00:54:16.547235 27580 tablet_service.cc:1514] Processing DeleteTablet for tablet e5c5757226c74522b7760c8eb3a69020 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:16 UTC) from {username='slave'} at 127.0.0.1:35662
I20260811 00:54:16.547266 27752 tablet_replica.cc:330] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: stopping tablet replica
I20260811 00:54:16.547351 27753 raft_consensus.cc:2229] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:16.547358 27752 raft_consensus.cc:2229] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:16.547433 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27015
I20260811 00:54:16.547448 27753 raft_consensus.cc:2258] T e5c5757226c74522b7760c8eb3a69020 P b4190cfed51c43a7a209a768d3e4e082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:16.547458 27752 raft_consensus.cc:2258] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:16.554294 27755 tablet_replica.cc:330] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: stopping tablet replica
I20260811 00:54:16.554453 27755 raft_consensus.cc:2229] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:54:16.554590 27755 raft_consensus.cc:2258] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 00:54:16.571338 26877 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:42773 (error 108)
I20260811 00:54:16.572062 27701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.571903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:42773 (local address 127.0.0.1:57590)
0811 00:54:16.571977 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.572023 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 00:54:16.572096 27755 ts_tablet_manager.cc:1905] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:16.572180 27752 ts_tablet_manager.cc:1905] T e5c5757226c74522b7760c8eb3a69020 P 5d1331033a6e4354a9323a0c587a4aa4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 00:54:16.572404 26877 catalog_manager.cc:4584] TS b4190cfed51c43a7a209a768d3e4e082 (127.26.99.129:42773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5c5757226c74522b7760c8eb3a69020: Network error: Client connection negotiation failed: client connection to 127.26.99.129:42773: connect: Connection refused (error 111)
I20260811 00:54:16.573645 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27255
I20260811 00:54:16.585216 27755 ts_tablet_manager.cc:1918] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:16.585366 27755 log.cc:1196] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/e5c5757226c74522b7760c8eb3a69020
I20260811 00:54:16.585680 27755 ts_tablet_manager.cc:1939] T e5c5757226c74522b7760c8eb3a69020 P f6de2db0f8984f368e5676c68cea2213: Deleting consensus metadata
I20260811 00:54:16.586179 26877 catalog_manager.cc:4841] TS f6de2db0f8984f368e5676c68cea2213 (127.26.99.131:39835): tablet e5c5757226c74522b7760c8eb3a69020 (table test-table [id=311723c2e8694f2fa5d0490633f88aa2]) successfully deleted
I20260811 00:54:16.604815 27701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:16.604659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39333 (local address 127.0.0.1:33414)
0811 00:54:16.604728 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:16.604766 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.130:39333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 00:54:16.604866 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27466
I20260811 00:54:16.623171 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 26853
2026-08-11T00:54:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (723 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:16 dist-test-slave-xt4k krb5kdc[27768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:16 dist-test-slave-xt4k krb5kdc[27768](info): set up 2 sockets
Aug 11 00:54:16 dist-test-slave-xt4k krb5kdc[27768](info): commencing operation
krb5kdc: starting...
W20260811 00:54:17.817028 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:17 dist-test-slave-xt4k krb5kdc[27768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:17.935509 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39795
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:39795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:18.016032 27793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:18.016240 27793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:18.016263 27793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:18.017444 27793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:18.017491 27793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:18.017504 27793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:18.017515 27793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:18.017526 27793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:18.019050 27793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:39795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:39795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:18.019291 27793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:18.019510 27793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:18.024255 27807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.024246 27809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.024246 27802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.024480 27793 server_base.cc:1034] running on GCE node
I20260811 00:54:18.024699 27793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:18.024988 27793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:18.026156 27793 hybrid_clock.cc:648] HybridClock initialized: now 1786409658026142 us; error 29 us; skew 500 ppm
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:18.028622 27793 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:18.029062 27793 webserver.cc:460] Webserver started at http://127.26.99.190:42685/ using document root <none> and password file <none>
I20260811 00:54:18.029273 27793 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:18.029316 27793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:18.029435 27793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:18.030467 27793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "1ef9fe22f36d48fc834da1e4ed5507a2"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "d13c57b1b1bc44be3f05ad514f16fbc3"
server_key_iv: "cf4b31f222b6fcd503e536d709558616"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.030812 27793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "1ef9fe22f36d48fc834da1e4ed5507a2"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "d13c57b1b1bc44be3f05ad514f16fbc3"
server_key_iv: "cf4b31f222b6fcd503e536d709558616"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.032091 27793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:18.032851 27821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.032998 27793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.033093 27793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "1ef9fe22f36d48fc834da1e4ed5507a2"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "d13c57b1b1bc44be3f05ad514f16fbc3"
server_key_iv: "cf4b31f222b6fcd503e536d709558616"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.033156 27793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:18.048252 27793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:18.050087 27793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:18.050217 27793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:18.054162 27793 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:39795
I20260811 00:54:18.054253 27909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:39795 every 8 connection(s)
I20260811 00:54:18.054533 27793 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:18.055373 27911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:18.057629 27911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: Bootstrap starting.
I20260811 00:54:18.058182 27911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:18.058446 27911 log.cc:824] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:18.059124 27911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: No bootstrap required, opened a new log
I20260811 00:54:18.060377 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27793
I20260811 00:54:18.060483 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:18.060657 27022 external_mini_cluster.cc:1428] Setting key fb167d9b9b966e94152f877b653cd1e9
I20260811 00:54:18.060861 27911 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } }
I20260811 00:54:18.061020 27911 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:18.061057 27911 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef9fe22f36d48fc834da1e4ed5507a2, State: Initialized, Role: FOLLOWER
I20260811 00:54:18.061208 27911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } }
I20260811 00:54:18.061352 27911 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:18.061403 27911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:18.061465 27911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:18.062487 27911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } }
I20260811 00:54:18.062597 27911 leader_election.cc:302] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ef9fe22f36d48fc834da1e4ed5507a2; no voters:
I20260811 00:54:18.062753 27911 leader_election.cc:288] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:18.062803 27916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:18.062950 27916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef9fe22f36d48fc834da1e4ed5507a2, State: Running, Role: LEADER
I20260811 00:54:18.062996 27911 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:18.063072 27916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } }
I20260811 00:54:18.063410 27916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ef9fe22f36d48fc834da1e4ed5507a2. Latest consensus state: current_term: 1 leader_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } } }
I20260811 00:54:18.063422 27918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef9fe22f36d48fc834da1e4ed5507a2" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 39795 } } }
I20260811 00:54:18.063577 27918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:18.063772 27916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:18.064097 27932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:18.064628 27932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:18.066179 27932 catalog_manager.cc:1347] Generated new cluster ID: 3406ae13017c4d01ac20c916cafbf9ae
I20260811 00:54:18.066233 27932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:18.070786 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.061143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34084 (local address 127.26.99.190:39795)
0811 00:54:18.061355 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.061365 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.061403 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:54:18.061534 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.061542 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.061598 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.061748 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.062320 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.063703 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.064745 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.065219 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.065318 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.067588 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.067591 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.067592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:18.067601 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.069310 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.069622 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.069624 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.069625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.069726 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.069953 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.069954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.069954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.070227 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.070344 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.070452 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.070589 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":109,"threads_started":1}
I20260811 00:54:18.094081 27932 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:18.094847 27932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:18.105052 27932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: Generated new TSK 0
I20260811 00:54:18.105252 27932 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:54:18.137183 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:18.219503 27958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:18.219710 27958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:18.219743 27958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:18.220913 27958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:18.220954 27958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:18.220990 27958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:18.222470 27958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:18.222710 27958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:18.222918 27958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:54:18.227718 27958 server_base.cc:1034] running on GCE node
W20260811 00:54:18.227708 27968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.227699 27967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.227679 27973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.228058 27958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:18.228294 27958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:18.229452 27958 hybrid_clock.cc:648] HybridClock initialized: now 1786409658229436 us; error 35 us; skew 500 ppm
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:18.231853 27958 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:54:18.232249 27958 webserver.cc:460] Webserver started at http://127.26.99.129:37487/ using document root <none> and password file <none>
I20260811 00:54:18.232503 27958 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:18.232553 27958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:18.232676 27958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:18.233639 27958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "5c28b11a9ebe006fc09bfb91892264db"
server_key_iv: "f502f039bdcd610da3bdfbac43534fe2"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.233956 27958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "5c28b11a9ebe006fc09bfb91892264db"
server_key_iv: "f502f039bdcd610da3bdfbac43534fe2"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.235170 27958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:18.235839 27985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.235996 27958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:18.236078 27958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "5c28b11a9ebe006fc09bfb91892264db"
server_key_iv: "f502f039bdcd610da3bdfbac43534fe2"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.236135 27958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:18.250527 27958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:18.252643 27958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:18.252772 27958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:18.252980 27958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:18.253273 27958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:18.253305 27958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.253333 27958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:18.253357 27958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.258812 27958 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:39229
I20260811 00:54:18.258876 28188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:39229 every 8 connection(s)
I20260811 00:54:18.259166 27958 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:54:18.263077 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 27958
I20260811 00:54:18.263178 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:18.263362 27022 external_mini_cluster.cc:1428] Setting key 76029b30b4942a45eab1d1bba3084ef1
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:18.268961 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.259853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:47613 (local address 127.26.99.190:39795)
0811 00:54:18.259918 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.259921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.260099 (+ 178us) server_negotiation.cc:407] Connection header received
0811 00:54:18.260673 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.260675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.260692 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.260744 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.261704 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.262226 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.263339 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.263637 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.263720 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.266183 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.266184 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.266185 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:18.266192 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.267437 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.267922 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.267922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.267923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.267978 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.268266 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.268267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.268268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.268431 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.268491 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.268826 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.268896 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:54:18.269220 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.259803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39795 (local address 127.26.99.129:47613)
0811 00:54:18.259979 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.260016 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.260571 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.260812 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.260815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.261392 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:18.261601 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.261606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.262318 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.262319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.263260 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.263263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.263795 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.263796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.264005 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.264582 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:18.264590 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:18.266076 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:18.267524 (+ 1448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.267533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.267535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.267843 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.268037 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.268038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.268038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.268186 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.268494 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:18.268502 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:18.268682 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.268802 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.268980 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260811 00:54:18.269896 28189 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39795
I20260811 00:54:18.270006 28189 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:18.270215 28189 heartbeater.cc:511] Master 127.26.99.190:39795 requested a full tablet report, sending...
I20260811 00:54:18.270838 27851 ts_manager.cc:194] Registered new tserver with Master: 3073aa68ddbe4068aa2ce03a6aa4a1fb (127.26.99.129:39229)
I20260811 00:54:18.271762 27851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:47613
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:54:18.291455 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:18.373389 28198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:18.373588 28198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:18.373610 28198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:18.374682 28198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:18.374714 28198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:18.374738 28198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:18.376132 28198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:18.376359 28198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:18.376576 28198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:18.381319 28204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.381315 28210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.381310 28205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.381570 28198 server_base.cc:1034] running on GCE node
I20260811 00:54:18.381744 28198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:18.381935 28198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:18.383086 28198 hybrid_clock.cc:648] HybridClock initialized: now 1786409658383078 us; error 28 us; skew 500 ppm
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:18.385474 28198 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:54:18.385901 28198 webserver.cc:460] Webserver started at http://127.26.99.130:44785/ using document root <none> and password file <none>
I20260811 00:54:18.386128 28198 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:18.386178 28198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:18.386308 28198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:18.387332 28198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "96c0769fa077493095329217e2eefd5c"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "1a12e541a566368e73b57f4a3697d7c9"
server_key_iv: "2b9cb7899417c7a479a6762f86ff2e49"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.387660 28198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "96c0769fa077493095329217e2eefd5c"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "1a12e541a566368e73b57f4a3697d7c9"
server_key_iv: "2b9cb7899417c7a479a6762f86ff2e49"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.388998 28198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:18.389725 28223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.389878 28198 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:18.389961 28198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "96c0769fa077493095329217e2eefd5c"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "1a12e541a566368e73b57f4a3697d7c9"
server_key_iv: "2b9cb7899417c7a479a6762f86ff2e49"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.390020 28198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:18.406072 28198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:18.407838 28198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:18.407974 28198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:18.408208 28198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:18.408576 28198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:18.408612 28198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.408640 28198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:18.408658 28198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.414191 28198 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:39397
I20260811 00:54:18.414251 28421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:39397 every 8 connection(s)
I20260811 00:54:18.414533 28198 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:54:18.417022 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28198
I20260811 00:54:18.417140 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:18.417348 27022 external_mini_cluster.cc:1428] Setting key 3038cf6b8f4c1ca4599f55601cbdfde3
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:18.423869 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.415240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:47051 (local address 127.26.99.190:39795)
0811 00:54:18.415298 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.415300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.415476 (+ 176us) server_negotiation.cc:407] Connection header received
0811 00:54:18.415944 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.415945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.415955 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.416021 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.416963 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.417708 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.418689 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.418896 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.418953 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.421270 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.421272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.421272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:18.421280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.422553 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.422928 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.422929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.422930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.422995 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.423228 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.423229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.423229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.423376 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.423449 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.423685 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.423771 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:54:18.423971 28425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.415203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39795 (local address 127.26.99.130:47051)
0811 00:54:18.415358 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.415399 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.415858 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.416077 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.416080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.416671 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:18.416860 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.416865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.417797 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.417798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.418596 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.418599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.418970 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.418971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.419092 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.419546 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:18.419555 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:18.421173 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:18.422629 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.422635 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.422637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.422851 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.423074 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.423074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.423075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.423170 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.423439 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:18.423442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:18.423561 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.423641 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.423791 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260811 00:54:18.424510 28423 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39795
I20260811 00:54:18.424629 28423 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:18.424839 28423 heartbeater.cc:511] Master 127.26.99.190:39795 requested a full tablet report, sending...
I20260811 00:54:18.425258 27851 ts_manager.cc:194] Registered new tserver with Master: 96c0769fa077493095329217e2eefd5c (127.26.99.130:39397)
I20260811 00:54:18.425769 27851 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:47051
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:54:18.442843 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:18.523022 28431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:18.523228 28431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:18.523262 28431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:18.524442 28431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:18.524484 28431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:18.524518 28431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:18.525987 28431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:18.526223 28431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:18.526436 28431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:18.531286 28441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.531417 28431 server_base.cc:1034] running on GCE node
W20260811 00:54:18.531332 28439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.531286 28446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.531724 28431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:18.531963 28431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:18.533121 28431 hybrid_clock.cc:648] HybridClock initialized: now 1786409658533104 us; error 28 us; skew 500 ppm
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:18.535576 28431 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:54:18.535998 28431 webserver.cc:460] Webserver started at http://127.26.99.131:33467/ using document root <none> and password file <none>
I20260811 00:54:18.536194 28431 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:18.536249 28431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:18.536401 28431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:18.537407 28431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "558d0c36492d474ba0b9a237155090ca"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "084e626ffb70b7381b2e70f713966594"
server_key_iv: "35c4be0083d19b4a2295e68fdaafeef1"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.537705 28431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "558d0c36492d474ba0b9a237155090ca"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "084e626ffb70b7381b2e70f713966594"
server_key_iv: "35c4be0083d19b4a2295e68fdaafeef1"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.538910 28431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:18.539558 28459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.539714 28431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:18.539799 28431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "558d0c36492d474ba0b9a237155090ca"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "084e626ffb70b7381b2e70f713966594"
server_key_iv: "35c4be0083d19b4a2295e68fdaafeef1"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.539860 28431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:18.550094 28431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:18.551808 28431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:18.551914 28431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:18.552093 28431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:18.552361 28431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:18.552390 28431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.552410 28431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:18.552426 28431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.557928 28431 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:45949
I20260811 00:54:18.557965 28661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:45949 every 8 connection(s)
I20260811 00:54:18.558250 28431 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:54:18 dist-test-slave-xt4k krb5kdc[27768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409658, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:18.567139 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.558928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:36749 (local address 127.26.99.190:39795)
0811 00:54:18.558994 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.558995 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.559176 (+ 181us) server_negotiation.cc:407] Connection header received
0811 00:54:18.559692 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.559693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.559706 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.559756 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.560747 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.561256 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.562225 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.562451 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.562509 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.564831 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.564832 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.564833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:18.564840 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.566099 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.566434 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.566435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.566435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.566482 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.566673 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.566673 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.566673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.566770 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.566815 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.567012 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.567075 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:54:18.567324 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.558907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:39795 (local address 127.26.99.131:36749)
0811 00:54:18.559060 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.559098 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.559595 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.559825 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.559829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.560440 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:18.560651 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.560657 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.561346 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.561347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.562135 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.562137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.562529 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.562530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.562678 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.563184 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:18.563193 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:18.564734 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:18.566163 (+ 1429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.566168 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.566169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.566377 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.566538 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:18.566539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:18.566539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:18.566628 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:18.566812 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:18.566815 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:18.566925 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.566998 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.567119 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260811 00:54:18.567487 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28431
I20260811 00:54:18.567584 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:18.567790 27022 external_mini_cluster.cc:1428] Setting key 22644845d15a9d1231045add39bc4fbe
I20260811 00:54:18.567826 28663 heartbeater.cc:347] Connected to a master server at 127.26.99.190:39795
I20260811 00:54:18.567924 28663 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:18.568118 28663 heartbeater.cc:511] Master 127.26.99.190:39795 requested a full tablet report, sending...
I20260811 00:54:18.568559 27849 ts_manager.cc:194] Registered new tserver with Master: 558d0c36492d474ba0b9a237155090ca (127.26.99.131:45949)
I20260811 00:54:18.568943 27849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:36749
I20260811 00:54:18.579414 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:18.586581 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.580669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.26.99.190:39795)
0811 00:54:18.580734 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.580736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.580791 (+ 55us) server_negotiation.cc:407] Connection header received
0811 00:54:18.580843 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.580844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.580852 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.580895 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.581386 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.581865 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.582576 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.582764 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.582817 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.584080 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.584082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.584082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:18.584088 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.585351 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.585788 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.585790 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.585790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.585852 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:18.586105 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:18.586105 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:18.586106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:18.586259 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.586340 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.586447 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.586502 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 00:54:18.588533 27849 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:18.590065 27849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:18.596426 28674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:39229 (local address 127.0.0.1:36474)
0811 00:54:18.592542 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.592584 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.592656 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.592974 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.592975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.592977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:18.593052 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.593054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.594062 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.594064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.595281 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.595283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596106 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.596194 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596207 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.596272 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.596327 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":2,"thread_start_us":59,"threads_started":1}
I20260811 00:54:18.596473 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36474 (local address 127.26.99.129:39229)
0811 00:54:18.592593 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.592598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.592735 (+ 137us) server_negotiation.cc:407] Connection header received
0811 00:54:18.592784 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.592786 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.592803 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.592876 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:18.593126 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.593969 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.595374 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596005 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596085 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596146 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.596296 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.596358 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260811 00:54:18.596614 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43818 (local address 127.26.99.130:39397)
0811 00:54:18.592746 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.592751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.592916 (+ 165us) server_negotiation.cc:407] Connection header received
0811 00:54:18.592957 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.592959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.592974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.593040 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:18.593219 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.594314 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.595372 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596043 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596113 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596181 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.596466 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.596526 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":98,"threads_started":1}
I20260811 00:54:18.596799 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48790 (local address 127.26.99.131:45949)
0811 00:54:18.592678 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.592682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.592691 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:18.592782 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.592784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.592800 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.592870 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:18.593144 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.594280 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.595561 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596242 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596300 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596383 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.596692 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.596739 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":123,"threads_started":1}
I20260811 00:54:18.596607 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:45949 (local address 127.0.0.1:48790)
0811 00:54:18.592634 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.592645 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.592710 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.592964 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.592968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.592971 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:18.593054 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.593056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.594388 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.594389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.595479 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.595481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596415 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.596471 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596474 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.596518 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.596549 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":49,"thread_start_us":59,"threads_started":1}
I20260811 00:54:18.596923 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.592424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39397 (local address 127.0.0.1:43818)
0811 00:54:18.592789 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.592798 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.592866 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.593112 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.593113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.593116 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:18.593154 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.593156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.594413 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.594414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.595295 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.595298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.596221 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.596222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.596283 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.596288 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.596332 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.596397 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":55,"threads_started":1}
I20260811 00:54:18.597580 28545 tablet_service.cc:1467] Processing CreateTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 (DEFAULT_TABLE table=test-table [id=4706369e68224a07a3a2f0222bdabcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:18.597661 28067 tablet_service.cc:1467] Processing CreateTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 (DEFAULT_TABLE table=test-table [id=4706369e68224a07a3a2f0222bdabcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:18.597940 28545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0912439d85b34eb3932d2e8ae06e81c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:18.597862 28309 tablet_service.cc:1467] Processing CreateTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 (DEFAULT_TABLE table=test-table [id=4706369e68224a07a3a2f0222bdabcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:18.598027 28067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0912439d85b34eb3932d2e8ae06e81c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:18.598140 28309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0912439d85b34eb3932d2e8ae06e81c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:18.600483 28680 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Bootstrap starting.
I20260811 00:54:18.601243 28683 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Bootstrap starting.
I20260811 00:54:18.601365 28680 tablet_bootstrap.cc:654] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:18.601898 28683 tablet_bootstrap.cc:654] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:18.601955 28680 log.cc:824] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:18.602434 28683 log.cc:824] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:18.602777 28680 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: No bootstrap required, opened a new log
I20260811 00:54:18.602788 28685 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: Bootstrap starting.
I20260811 00:54:18.602854 28680 ts_tablet_manager.cc:1397] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:18.603109 28683 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: No bootstrap required, opened a new log
I20260811 00:54:18.603170 28683 ts_tablet_manager.cc:1397] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:18.603406 28685 tablet_bootstrap.cc:654] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:18.604200 28685 log.cc:824] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:18.604754 28680 raft_consensus.cc:348] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.604784 28683 raft_consensus.cc:348] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.604935 28683 raft_consensus.cc:374] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:18.604936 28680 raft_consensus.cc:374] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:18.604966 28683 raft_consensus.cc:729] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96c0769fa077493095329217e2eefd5c, State: Initialized, Role: FOLLOWER
I20260811 00:54:18.604976 28680 raft_consensus.cc:729] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558d0c36492d474ba0b9a237155090ca, State: Initialized, Role: FOLLOWER
I20260811 00:54:18.604995 28685 tablet_bootstrap.cc:492] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: No bootstrap required, opened a new log
I20260811 00:54:18.605046 28685 ts_tablet_manager.cc:1397] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:18.605101 28683 consensus_queue.cc:260] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.605105 28680 consensus_queue.cc:260] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.605371 28683 ts_tablet_manager.cc:1428] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 00:54:18.605377 28680 ts_tablet_manager.cc:1428] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:54:18.605487 28423 heartbeater.cc:503] Master 127.26.99.190:39795 was elected leader, sending a full tablet report...
I20260811 00:54:18.605645 28663 heartbeater.cc:503] Master 127.26.99.190:39795 was elected leader, sending a full tablet report...
I20260811 00:54:18.606851 28685 raft_consensus.cc:348] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.606992 28685 raft_consensus.cc:374] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:18.607024 28685 raft_consensus.cc:729] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3073aa68ddbe4068aa2ce03a6aa4a1fb, State: Initialized, Role: FOLLOWER
I20260811 00:54:18.607137 28685 consensus_queue.cc:260] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.607429 28189 heartbeater.cc:503] Master 127.26.99.190:39795 was elected leader, sending a full tablet report...
I20260811 00:54:18.607456 28685 ts_tablet_manager.cc:1428] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 00:54:18.665078 28424 tablet.cc:2369] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:54:18.680706 28700 raft_consensus.cc:482] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:18.680850 28700 raft_consensus.cc:504] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.681258 28700 leader_election.cc:288] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558d0c36492d474ba0b9a237155090ca (127.26.99.131:45949), 96c0769fa077493095329217e2eefd5c (127.26.99.130:39397)
I20260811 00:54:18.685194 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.681596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:46429 (local address 127.26.99.130:39397)
0811 00:54:18.681644 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.681646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.681679 (+ 33us) server_negotiation.cc:407] Connection header received
0811 00:54:18.681750 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.681752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.681760 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.681807 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:18.681944 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.682713 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684170 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.684798 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684873 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.684883 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.685078 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.685119 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:54:18.685194 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.681592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:40989 (local address 127.26.99.131:45949)
0811 00:54:18.681647 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.681649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.681657 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:18.681688 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.681689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.681699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.681750 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:18.681950 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.682722 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684169 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.684797 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684873 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.684883 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.685078 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.685118 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:54:18.685225 28191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.681426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:45949 (local address 127.26.99.129:40989)
0811 00:54:18.681483 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.681494 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.681541 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.681787 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.681788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.681790 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:18.681873 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.681875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.682820 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.682821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.684070 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.684074 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.684899 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.684994 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.684996 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.685056 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.685118 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":12}
I20260811 00:54:18.685235 28701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.681438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:39397 (local address 127.26.99.129:46429)
0811 00:54:18.681623 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.681633 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:18.681692 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:18.681822 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:18.681822 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:18.681824 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:18.681886 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.681887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.682821 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.682821 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.684070 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:18.684074 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.684899 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.684900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:18.684990 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.684996 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 00:54:18.685057 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:54:18.685118 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":48,"thread_start_us":116,"threads_started":1}
I20260811 00:54:18.685598 28344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0912439d85b34eb3932d2e8ae06e81c5" candidate_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96c0769fa077493095329217e2eefd5c" is_pre_election: true
I20260811 00:54:18.685609 28581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0912439d85b34eb3932d2e8ae06e81c5" candidate_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558d0c36492d474ba0b9a237155090ca" is_pre_election: true
I20260811 00:54:18.685748 28344 raft_consensus.cc:2454] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3073aa68ddbe4068aa2ce03a6aa4a1fb in term 0.
I20260811 00:54:18.685753 28581 raft_consensus.cc:2454] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3073aa68ddbe4068aa2ce03a6aa4a1fb in term 0.
I20260811 00:54:18.685971 27992 leader_election.cc:302] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3073aa68ddbe4068aa2ce03a6aa4a1fb, 96c0769fa077493095329217e2eefd5c; no voters:
I20260811 00:54:18.686101 28700 raft_consensus.cc:2781] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:18.686162 28700 raft_consensus.cc:482] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:18.686187 28700 raft_consensus.cc:3037] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:18.687049 28700 raft_consensus.cc:504] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.687177 28700 leader_election.cc:288] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [CANDIDATE]: Term 1 election: Requested vote from peers 558d0c36492d474ba0b9a237155090ca (127.26.99.131:45949), 96c0769fa077493095329217e2eefd5c (127.26.99.130:39397)
I20260811 00:54:18.687354 28344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0912439d85b34eb3932d2e8ae06e81c5" candidate_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96c0769fa077493095329217e2eefd5c"
I20260811 00:54:18.687440 28344 raft_consensus.cc:3037] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:18.688160 28344 raft_consensus.cc:2454] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3073aa68ddbe4068aa2ce03a6aa4a1fb in term 1.
I20260811 00:54:18.688270 28581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0912439d85b34eb3932d2e8ae06e81c5" candidate_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558d0c36492d474ba0b9a237155090ca"
I20260811 00:54:18.688311 27992 leader_election.cc:302] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3073aa68ddbe4068aa2ce03a6aa4a1fb, 96c0769fa077493095329217e2eefd5c; no voters:
I20260811 00:54:18.688378 28581 raft_consensus.cc:3037] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:18.688447 28700 raft_consensus.cc:2781] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:18.688630 28700 raft_consensus.cc:686] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [term 1 LEADER]: Becoming Leader. State: Replica: 3073aa68ddbe4068aa2ce03a6aa4a1fb, State: Running, Role: LEADER
I20260811 00:54:18.688730 28700 consensus_queue.cc:237] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } }
I20260811 00:54:18.689316 28581 raft_consensus.cc:2454] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3073aa68ddbe4068aa2ce03a6aa4a1fb in term 1.
I20260811 00:54:18.689626 27849 catalog_manager.cc:5495] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 3073aa68ddbe4068aa2ce03a6aa4a1fb (127.26.99.129). New cstate: current_term: 1 leader_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3073aa68ddbe4068aa2ce03a6aa4a1fb" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 } health_report { overall_health: UNKNOWN } } }
I20260811 00:54:18.714397 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.712251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36488 (local address 127.26.99.129:39229)
0811 00:54:18.712305 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.712307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.712314 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:18.712379 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.712381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.712403 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.712463 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:18.712577 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.713040 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.713759 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.713934 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.713976 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.714103 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:18.714185 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:18.714252 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.714283 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.714292 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:54:18.716713 28344 raft_consensus.cc:1261] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 1 FOLLOWER]: Refusing update from remote peer 3073aa68ddbe4068aa2ce03a6aa4a1fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:18.717082 28700 consensus_queue.cc:1035] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "96c0769fa077493095329217e2eefd5c" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 39397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:18.717763 28581 raft_consensus.cc:1261] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 1 FOLLOWER]: Refusing update from remote peer 3073aa68ddbe4068aa2ce03a6aa4a1fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:18.718082 28702 consensus_queue.cc:1035] T 0912439d85b34eb3932d2e8ae06e81c5 P 3073aa68ddbe4068aa2ce03a6aa4a1fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "558d0c36492d474ba0b9a237155090ca" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 45949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:18.720685 28712 mvcc.cc:205] Tried to move back new op lower bound from 7317133962100527104 to 7317133961989591040. Current Snapshot: MvccSnapshot[applied={T|T < 7317133962100527104 or (T in {7317133962100527104})}]
I20260811 00:54:18.722875 27851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:18.722958 27851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:18.723628 27851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ef9fe22f36d48fc834da1e4ed5507a2: Sending DeleteTablet for 3 replicas of tablet 0912439d85b34eb3932d2e8ae06e81c5
I20260811 00:54:18.723946 28545 tablet_service.cc:1514] Processing DeleteTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:18 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:48790
I20260811 00:54:18.723948 28067 tablet_service.cc:1514] Processing DeleteTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:18 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:36474
I20260811 00:54:18.724155 28309 tablet_service.cc:1514] Processing DeleteTablet for tablet 0912439d85b34eb3932d2e8ae06e81c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:18 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:43818
I20260811 00:54:18.724388 28730 tablet_replica.cc:330] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: stopping tablet replica
I20260811 00:54:18.724509 28730 raft_consensus.cc:2229] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:18.724611 28730 raft_consensus.cc:2258] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:18.724618 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27958
I20260811 00:54:18.724639 28727 tablet_replica.cc:330] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: stopping tablet replica
I20260811 00:54:18.724826 28727 raft_consensus.cc:2229] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:18.724969 28727 raft_consensus.cc:2258] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:18.734959 28730 ts_tablet_manager.cc:1905] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:18.736690 28730 ts_tablet_manager.cc:1918] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:18.736778 28730 log.cc:1196] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/0912439d85b34eb3932d2e8ae06e81c5
I20260811 00:54:18.737048 28730 ts_tablet_manager.cc:1939] T 0912439d85b34eb3932d2e8ae06e81c5 P 96c0769fa077493095329217e2eefd5c: Deleting consensus metadata
I20260811 00:54:18.737567 27827 catalog_manager.cc:4841] TS 96c0769fa077493095329217e2eefd5c (127.26.99.130:39397): tablet 0912439d85b34eb3932d2e8ae06e81c5 (table test-table [id=4706369e68224a07a3a2f0222bdabcd3]) successfully deleted
I20260811 00:54:18.741241 28727 ts_tablet_manager.cc:1905] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 00:54:18.741477 27827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:39229 (error 108)
I20260811 00:54:18.741963 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.741826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:39229 (local address 127.0.0.1:36500)
0811 00:54:18.741875 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:18.741910 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:39229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:54:18.742085 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28198
W20260811 00:54:18.742159 27827 catalog_manager.cc:4584] TS 3073aa68ddbe4068aa2ce03a6aa4a1fb (127.26.99.129:39229): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0912439d85b34eb3932d2e8ae06e81c5: Network error: Client connection negotiation failed: client connection to 127.26.99.129:39229: connect: Connection refused (error 111)
I20260811 00:54:18.743042 28727 ts_tablet_manager.cc:1918] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:18.743153 28727 log.cc:1196] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/0912439d85b34eb3932d2e8ae06e81c5
I20260811 00:54:18.743563 28727 ts_tablet_manager.cc:1939] T 0912439d85b34eb3932d2e8ae06e81c5 P 558d0c36492d474ba0b9a237155090ca: Deleting consensus metadata
I20260811 00:54:18.744159 27824 catalog_manager.cc:4841] TS 558d0c36492d474ba0b9a237155090ca (127.26.99.131:45949): tablet 0912439d85b34eb3932d2e8ae06e81c5 (table test-table [id=4706369e68224a07a3a2f0222bdabcd3]) successfully deleted
I20260811 00:54:18.754096 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28431
I20260811 00:54:18.766737 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 27793
2026-08-11T00:54:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2146 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T00:54:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:18Z Disabled control of system clock
I20260811 00:54:18.807476 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35833
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:35833
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:18.890811 28737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:18.891031 28737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:18.891055 28737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:18.892168 28737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:18.892207 28737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:18.892218 28737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:18.892230 28737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:18.892241 28737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:18.893600 28737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:35833
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:18.893798 28737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:18.894037 28737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:18.898641 28747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:18.898667 28748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.898734 28737 server_base.cc:1034] running on GCE node
W20260811 00:54:18.898651 28750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:18.899044 28737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:18.899313 28737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:18.900444 28737 hybrid_clock.cc:648] HybridClock initialized: now 1786409658900430 us; error 29 us; skew 500 ppm
I20260811 00:54:18.901638 28737 webserver.cc:460] Webserver started at http://127.26.99.190:44613/ using document root <none> and password file <none>
I20260811 00:54:18.901861 28737 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:18.901906 28737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:18.902024 28737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:18.903031 28737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "49421119783d4473ac9fdd209a843399"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "2d84b53e66212e0d96a887bf9a991350"
server_key_iv: "6395658e3cd805252b4c0f76990522b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.903353 28737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "49421119783d4473ac9fdd209a843399"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "2d84b53e66212e0d96a887bf9a991350"
server_key_iv: "6395658e3cd805252b4c0f76990522b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.904603 28737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:54:18.905252 28766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.905390 28737 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:18.905470 28737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "49421119783d4473ac9fdd209a843399"
format_stamp: "Formatted at 2026-08-11 00:54:18 on dist-test-slave-xt4k"
server_key: "2d84b53e66212e0d96a887bf9a991350"
server_key_iv: "6395658e3cd805252b4c0f76990522b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:18.905535 28737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:18.922494 28737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:18.922775 28737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:18.922904 28737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:18.926618 28737 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:35833
I20260811 00:54:18.926653 28863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:35833 every 8 connection(s)
I20260811 00:54:18.926963 28737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:18.927994 28870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:18.930302 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: Bootstrap starting.
I20260811 00:54:18.930866 28870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:18.931147 28870 log.cc:824] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:18.931704 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28737
I20260811 00:54:18.931811 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:18.931818 28870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: No bootstrap required, opened a new log
I20260811 00:54:18.932010 27022 external_mini_cluster.cc:1428] Setting key 07ae9f144c0b0427bc82ad95b0b3397a
I20260811 00:54:18.933616 28870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } }
I20260811 00:54:18.933754 28870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:18.933785 28870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49421119783d4473ac9fdd209a843399, State: Initialized, Role: FOLLOWER
I20260811 00:54:18.933933 28870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } }
I20260811 00:54:18.934020 28870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:18.934051 28870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:18.934103 28870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:18.934582 28870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } }
I20260811 00:54:18.934665 28870 leader_election.cc:302] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49421119783d4473ac9fdd209a843399; no voters:
I20260811 00:54:18.934829 28870 leader_election.cc:288] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:18.934882 28882 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:18.935003 28882 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [term 1 LEADER]: Becoming Leader. State: Replica: 49421119783d4473ac9fdd209a843399, State: Running, Role: LEADER
I20260811 00:54:18.935083 28882 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } }
I20260811 00:54:18.935088 28870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:18.936276 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49421119783d4473ac9fdd209a843399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } } }
I20260811 00:54:18.936417 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:18.936280 28883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49421119783d4473ac9fdd209a843399. Latest consensus state: current_term: 1 leader_uuid: "49421119783d4473ac9fdd209a843399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49421119783d4473ac9fdd209a843399" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35833 } } }
I20260811 00:54:18.936698 28883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399 [sys.catalog]: This master's current role is: LEADER
W20260811 00:54:18.936959 28909 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:18.937014 28909 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:18.937086 28911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:18.937283 28911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:18.938709 28911 catalog_manager.cc:1347] Generated new cluster ID: 265e71e8a6194f94babb3284ba8685c4
I20260811 00:54:18.938762 28911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:18.939122 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:18.932518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.26.99.190:35833)
0811 00:54:18.932723 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:18.932730 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:18.932768 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:54:18.933601 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:18.933609 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:18.933669 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:18.933782 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:18.934421 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.936066 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.937123 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:18.937606 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:18.937717 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:18.938413 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:18.938417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:18.938418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:18.938588 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:18.938626 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:18.938640 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:18.938701 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:18.938863 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 00:54:18.938948 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
I20260811 00:54:18.945083 28911 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:18.945736 28911 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:18.956606 28911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: Generated new TSK 0
I20260811 00:54:18.956781 28911 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:18.967037 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--builtin_ntp_servers=127.26.99.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:19.049062 28916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:19.049257 28916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:19.049288 28916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:19.050416 28916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:19.050455 28916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:19.050489 28916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:19.051838 28916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:19.052071 28916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:19.052387 28916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:19.057112 28923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.057168 28922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.057129 28927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:19.057690 28916 server_base.cc:1034] running on GCE node
I20260811 00:54:19.057889 28916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:19.058143 28916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:19.059293 28916 hybrid_clock.cc:648] HybridClock initialized: now 1786409659059280 us; error 31 us; skew 500 ppm
I20260811 00:54:19.060578 28916 webserver.cc:460] Webserver started at http://127.26.99.129:33877/ using document root <none> and password file <none>
I20260811 00:54:19.060839 28916 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:19.060884 28916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:19.061012 28916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:19.062058 28916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "5497e09008ba44fd826cc9863d81fa28"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f6f3e16033be308d0f099e386cce7564"
server_key_iv: "1c74e53900265139bfadbcff680faf83"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.062414 28916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "5497e09008ba44fd826cc9863d81fa28"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f6f3e16033be308d0f099e386cce7564"
server_key_iv: "1c74e53900265139bfadbcff680faf83"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.063702 28916 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:19.064364 28938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.064518 28916 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:19.064633 28916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "5497e09008ba44fd826cc9863d81fa28"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f6f3e16033be308d0f099e386cce7564"
server_key_iv: "1c74e53900265139bfadbcff680faf83"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.064689 28916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:19.091094 28916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:19.091387 28916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:19.091490 28916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:19.091708 28916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:19.092010 28916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:19.092041 28916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.092067 28916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:19.092080 28916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.097530 28916 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:39663
I20260811 00:54:19.097592 29133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:39663 every 8 connection(s)
I20260811 00:54:19.097923 28916 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:54:19.102923 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 28916
I20260811 00:54:19.103027 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:19.103186 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.098763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:55435 (local address 127.26.99.190:35833)
0811 00:54:19.098808 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.098810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.099048 (+ 238us) server_negotiation.cc:407] Connection header received
0811 00:54:19.099581 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.099582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.099596 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.099649 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:19.100357 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.100873 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.101838 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.102067 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.102124 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.102878 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:19.102880 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:19.102880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:19.102885 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:19.102900 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:19.102903 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:19.102948 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.103060 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.103101 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:54:19.103256 27022 external_mini_cluster.cc:1428] Setting key dcd9cb4a19941aa72523b41246e45f4e
I20260811 00:54:19.103334 29139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.098740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35833 (local address 127.26.99.129:55435)
0811 00:54:19.098937 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.098970 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.099473 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.099720 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.099724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.099735 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:19.100250 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.100255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.100957 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.100959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.101753 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.101756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.102140 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.102142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.102266 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.102735 (+ 469us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:19.102735 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:19.102780 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:19.102802 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:19.102954 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:19.102959 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:19.102962 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.103040 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.103145 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260811 00:54:19.103783 29135 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35833
I20260811 00:54:19.103888 29135 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:19.104087 29135 heartbeater.cc:511] Master 127.26.99.190:35833 requested a full tablet report, sending...
I20260811 00:54:19.104283 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--builtin_ntp_servers=127.26.99.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:54:19.104655 28791 ts_manager.cc:194] Registered new tserver with Master: 5497e09008ba44fd826cc9863d81fa28 (127.26.99.129:39663)
I20260811 00:54:19.105262 28791 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.129:55435
W20260811 00:54:19.186554 29140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:19.186761 29140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:19.186784 29140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:19.187929 29140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:19.187971 29140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:19.187995 29140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:19.189406 29140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:19.189647 29140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:19.189944 29140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:19.194726 29149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.194697 29147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.194680 29145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:19.195076 29140 server_base.cc:1034] running on GCE node
I20260811 00:54:19.195274 29140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:19.195494 29140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:19.196637 29140 hybrid_clock.cc:648] HybridClock initialized: now 1786409659196628 us; error 29 us; skew 500 ppm
I20260811 00:54:19.197855 29140 webserver.cc:460] Webserver started at http://127.26.99.130:39035/ using document root <none> and password file <none>
I20260811 00:54:19.198091 29140 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:19.198141 29140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:19.198266 29140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:19.199306 29140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "e08a375eaae94e6697d6585f4cbf23e3"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f7a6782d13f8390c80f84844a05a945a"
server_key_iv: "3803ad56a35e9bd167514d46ef1ce91e"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.199663 29140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "e08a375eaae94e6697d6585f4cbf23e3"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f7a6782d13f8390c80f84844a05a945a"
server_key_iv: "3803ad56a35e9bd167514d46ef1ce91e"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.200944 29140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:19.201654 29163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.201817 29140 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:19.201911 29140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "e08a375eaae94e6697d6585f4cbf23e3"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "f7a6782d13f8390c80f84844a05a945a"
server_key_iv: "3803ad56a35e9bd167514d46ef1ce91e"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.201972 29140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:19.214092 29140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:19.214370 29140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:19.214497 29140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:19.214704 29140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:19.215005 29140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:19.215039 29140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.215076 29140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:19.215101 29140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.220693 29140 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:40667
I20260811 00:54:19.220758 29366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:40667 every 8 connection(s)
I20260811 00:54:19.221076 29140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:54:19.225992 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.221745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:60957 (local address 127.26.99.190:35833)
0811 00:54:19.221796 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.221799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.221990 (+ 191us) server_negotiation.cc:407] Connection header received
0811 00:54:19.222526 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.222527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.222540 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.222588 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:19.223257 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.223752 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.224746 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.224944 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.225001 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.225727 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:19.225728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:19.225729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:19.225733 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:19.225750 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:19.225754 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:19.225797 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.225877 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.225914 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:54:19.226166 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.221721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35833 (local address 127.26.99.130:60957)
0811 00:54:19.221877 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.221911 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.222423 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.222665 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.222668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.222676 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:19.223168 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.223173 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.223839 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.223839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.224662 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.224666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.225016 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.225017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.225138 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.225591 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:19.225591 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:19.225619 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:19.225642 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:19.225804 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:19.225809 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:19.225812 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.225871 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.225969 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260811 00:54:19.226660 29368 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35833
I20260811 00:54:19.226748 29368 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:19.226922 29368 heartbeater.cc:511] Master 127.26.99.190:35833 requested a full tablet report, sending...
I20260811 00:54:19.227299 28791 ts_manager.cc:194] Registered new tserver with Master: e08a375eaae94e6697d6585f4cbf23e3 (127.26.99.130:40667)
I20260811 00:54:19.227628 28791 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.130:60957
I20260811 00:54:19.230201 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29140
I20260811 00:54:19.230310 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:19.230525 27022 external_mini_cluster.cc:1428] Setting key dd8c520739d21326aad2626e8a70be70
I20260811 00:54:19.231484 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--builtin_ntp_servers=127.26.99.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:19.313233 29375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:19.313422 29375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:19.313441 29375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:19.314541 29375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:19.314579 29375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:19.314605 29375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:19.315878 29375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35833
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:19.316102 29375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:19.316406 29375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:19.321087 29384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.321146 29386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:19.321097 29391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:19.321430 29375 server_base.cc:1034] running on GCE node
I20260811 00:54:19.321645 29375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:19.321877 29375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:19.323015 29375 hybrid_clock.cc:648] HybridClock initialized: now 1786409659323003 us; error 31 us; skew 500 ppm
I20260811 00:54:19.324203 29375 webserver.cc:460] Webserver started at http://127.26.99.131:43487/ using document root <none> and password file <none>
I20260811 00:54:19.324457 29375 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:19.324508 29375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:19.324651 29375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:19.325687 29375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "a070c226578e41d29f305b1c240c4317"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "640ff14926b1bab7f249fadf62e7d38c"
server_key_iv: "448d4780c6d1b04229f6d2963aa5931c"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.326020 29375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "a070c226578e41d29f305b1c240c4317"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "640ff14926b1bab7f249fadf62e7d38c"
server_key_iv: "448d4780c6d1b04229f6d2963aa5931c"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.327212 29375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:19.327960 29406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.328135 29375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:19.328227 29375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "a070c226578e41d29f305b1c240c4317"
format_stamp: "Formatted at 2026-08-11 00:54:19 on dist-test-slave-xt4k"
server_key: "640ff14926b1bab7f249fadf62e7d38c"
server_key_iv: "448d4780c6d1b04229f6d2963aa5931c"
server_key_version: "encryptionkey@0"
I20260811 00:54:19.328300 29375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:19.353318 29375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:19.353602 29375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:19.353729 29375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:19.353943 29375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:19.354252 29375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:19.354286 29375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.354314 29375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:19.354337 29375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:19.359540 29375 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:46465
I20260811 00:54:19.359608 29596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:46465 every 8 connection(s)
I20260811 00:54:19.359905 29375 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:54:19.365022 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.360739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:55389 (local address 127.26.99.190:35833)
0811 00:54:19.360816 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.360818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.361025 (+ 207us) server_negotiation.cc:407] Connection header received
0811 00:54:19.361474 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.361475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.361487 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.361557 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:19.362225 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.362772 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.363794 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.364002 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.364058 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.364787 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:19.364788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:19.364789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:19.364793 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:19.364807 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:19.364810 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:19.364852 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.364911 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.364937 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:54:19.365188 29606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.360679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35833 (local address 127.26.99.131:55389)
0811 00:54:19.360861 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.360902 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.361375 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.361609 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.361612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.361621 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:19.362126 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.362130 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.362885 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.362886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.363703 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.363706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.364071 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.364071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.364176 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.364666 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:19.364667 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:19.364695 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:19.364720 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:19.364859 (+ 139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:19.364862 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:19.364864 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.364909 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.364988 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260811 00:54:19.365650 29599 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35833
I20260811 00:54:19.365741 29599 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:19.365914 29599 heartbeater.cc:511] Master 127.26.99.190:35833 requested a full tablet report, sending...
I20260811 00:54:19.366286 28791 ts_manager.cc:194] Registered new tserver with Master: a070c226578e41d29f305b1c240c4317 (127.26.99.131:46465)
I20260811 00:54:19.366632 28791 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.131:55389
I20260811 00:54:19.366988 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29375
I20260811 00:54:19.367101 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:19.367331 27022 external_mini_cluster.cc:1428] Setting key 4e25db630c9b909dd863d0f548cdf9a6
I20260811 00:54:19.368119 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:19.372170 28879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.369464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34238 (local address 127.26.99.190:35833)
0811 00:54:19.369520 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.369522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.369620 (+ 98us) server_negotiation.cc:407] Connection header received
0811 00:54:19.369682 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.369683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.369695 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.369739 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:19.369883 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.370349 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.371063 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.371263 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.371314 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.371904 (+ 590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:19.371905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:19.371906 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:19.371910 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:19.371924 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:19.371928 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:19.372009 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.372082 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.372092 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:54:19.373612 28791 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:19.375092 28791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:19.380798 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:46465 (local address 127.0.0.1:47296)
0811 00:54:19.377185 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.377226 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.377284 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.377760 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.377760 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.377762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:19.377810 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.377811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.378773 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.378773 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.379654 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.379656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.380505 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.380506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.380596 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.380610 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.380672 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.380728 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260811 00:54:19.380815 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47296 (local address 127.26.99.131:46465)
0811 00:54:19.377583 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.377588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.377599 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:19.377645 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.377647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.377663 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.377877 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:19.377918 (+ 41us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.378711 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.379741 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.380433 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.380496 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.380587 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.380698 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.380735 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":66,"threads_started":1}
I20260811 00:54:19.381539 29499 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc (DEFAULT_TABLE table=test-table [id=b291ccb31dd7405685cfeb7d957dbfe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:19.381743 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:39663 (local address 127.0.0.1:42652)
0811 00:54:19.377654 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.377663 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.377712 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.378303 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.378303 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.378306 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:19.378344 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.378345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.379524 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.379525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.380547 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.380550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.381573 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.381573 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.381622 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.381626 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.381661 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.381690 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":68,"threads_started":1}
I20260811 00:54:19.381789 29627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42652 (local address 127.26.99.129:39663)
0811 00:54:19.378152 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.378156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.378166 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:19.378201 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.378203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.378217 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.378291 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:19.378405 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.379433 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.380641 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.381471 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.381561 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.381648 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.381674 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.381713 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":99,"threads_started":1}
I20260811 00:54:19.381946 29499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2ae4eff7b840ca8f7c593474f83adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:19.384467 29628 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Bootstrap starting.
I20260811 00:54:19.384779 29623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:40667 (local address 127.0.0.1:38178)
0811 00:54:19.377401 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.377410 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.377463 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.377729 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.377732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.377734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:19.377798 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.377800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.379084 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.379085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.380063 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.380066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.381089 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.381090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.384621 (+ 3531us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.384626 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.384672 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.384713 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260811 00:54:19.384819 29622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.377168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38178 (local address 127.26.99.130:40667)
0811 00:54:19.377337 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.377341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.377465 (+ 124us) server_negotiation.cc:407] Connection header received
0811 00:54:19.377539 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.377541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.377564 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.377635 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:19.377885 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.378990 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.380149 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.380877 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.380947 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.381055 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.384702 (+ 3647us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.384743 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260811 00:54:19.385222 29628 tablet_bootstrap.cc:654] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:19.385109 29029 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc (DEFAULT_TABLE table=test-table [id=b291ccb31dd7405685cfeb7d957dbfe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:19.385450 29029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2ae4eff7b840ca8f7c593474f83adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:19.385397 29264 tablet_service.cc:1467] Processing CreateTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc (DEFAULT_TABLE table=test-table [id=b291ccb31dd7405685cfeb7d957dbfe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:19.385520 29628 log.cc:824] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:19.385641 29264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f2ae4eff7b840ca8f7c593474f83adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:19.386296 29628 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: No bootstrap required, opened a new log
I20260811 00:54:19.386354 29628 ts_tablet_manager.cc:1397] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:19.388034 29630 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Bootstrap starting.
I20260811 00:54:19.388584 29630 tablet_bootstrap.cc:654] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:19.388638 29631 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: Bootstrap starting.
I20260811 00:54:19.388888 29630 log.cc:824] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:19.388833 29628 raft_consensus.cc:348] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.389254 29631 tablet_bootstrap.cc:654] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:19.389264 29628 raft_consensus.cc:374] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:19.389315 29628 raft_consensus.cc:729] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a070c226578e41d29f305b1c240c4317, State: Initialized, Role: FOLLOWER
I20260811 00:54:19.389424 29628 consensus_queue.cc:260] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.389569 29630 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: No bootstrap required, opened a new log
I20260811 00:54:19.389564 29631 log.cc:824] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:19.389637 29630 ts_tablet_manager.cc:1397] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:19.389667 29628 ts_tablet_manager.cc:1428] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:54:19.389782 29599 heartbeater.cc:503] Master 127.26.99.190:35833 was elected leader, sending a full tablet report...
I20260811 00:54:19.390239 29631 tablet_bootstrap.cc:492] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: No bootstrap required, opened a new log
I20260811 00:54:19.390300 29631 ts_tablet_manager.cc:1397] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:19.391723 29630 raft_consensus.cc:348] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.391842 29630 raft_consensus.cc:374] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:19.391862 29630 raft_consensus.cc:729] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e08a375eaae94e6697d6585f4cbf23e3, State: Initialized, Role: FOLLOWER
I20260811 00:54:19.391953 29630 consensus_queue.cc:260] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.392199 29630 ts_tablet_manager.cc:1428] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:54:19.392194 29631 raft_consensus.cc:348] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.392357 29631 raft_consensus.cc:374] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:19.392405 29631 raft_consensus.cc:729] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5497e09008ba44fd826cc9863d81fa28, State: Initialized, Role: FOLLOWER
I20260811 00:54:19.392401 29368 heartbeater.cc:503] Master 127.26.99.190:35833 was elected leader, sending a full tablet report...
I20260811 00:54:19.392516 29631 consensus_queue.cc:260] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.392771 29631 ts_tablet_manager.cc:1428] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:54:19.392827 29135 heartbeater.cc:503] Master 127.26.99.190:35833 was elected leader, sending a full tablet report...
I20260811 00:54:19.467908 29636 raft_consensus.cc:482] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:19.468039 29636 raft_consensus.cc:504] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.468448 29636 leader_election.cc:288] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a070c226578e41d29f305b1c240c4317 (127.26.99.131:46465), e08a375eaae94e6697d6585f4cbf23e3 (127.26.99.130:40667)
W20260811 00:54:19.471572 29372 tablet.cc:2369] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:54:19.472158 29624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.468707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:47045 (local address 127.26.99.131:46465)
0811 00:54:19.468752 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.468754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.468977 (+ 223us) server_negotiation.cc:407] Connection header received
0811 00:54:19.469043 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.469044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.469053 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.469102 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:19.469209 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.469900 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471245 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.471816 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471874 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.471880 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.472043 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.472090 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:54:19.472163 29139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.468619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:40667 (local address 127.26.99.129:53645)
0811 00:54:19.468672 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.468686 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.468768 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.468928 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.468929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.468931 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:19.469005 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.469007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.469927 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.469928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.471156 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.471159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.471872 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.471960 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.471967 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.472025 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.472066 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":11}
I20260811 00:54:19.472393 29622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.468751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:53645 (local address 127.26.99.130:40667)
0811 00:54:19.468795 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.468797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.468808 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:19.468841 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.468841 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.468851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.468912 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:19.469077 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.469845 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471247 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.471796 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471868 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.471877 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.472267 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.472321 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:19.472169 29639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.468619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:46465 (local address 127.26.99.129:47045)
0811 00:54:19.468923 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.468931 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:19.468977 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:19.469103 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:19.469104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:19.469105 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:19.469159 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.469160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.469961 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.469962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.471156 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:19.471159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.471881 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.471882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:19.471960 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.471968 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 00:54:19.472033 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 00:54:19.472064 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":161,"thread_start_us":94,"threads_started":1}
I20260811 00:54:19.472675 29295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2ae4eff7b840ca8f7c593474f83adc" candidate_uuid: "5497e09008ba44fd826cc9863d81fa28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e08a375eaae94e6697d6585f4cbf23e3" is_pre_election: true
I20260811 00:54:19.472821 29295 raft_consensus.cc:2454] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5497e09008ba44fd826cc9863d81fa28 in term 0.
I20260811 00:54:19.472909 29526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2ae4eff7b840ca8f7c593474f83adc" candidate_uuid: "5497e09008ba44fd826cc9863d81fa28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a070c226578e41d29f305b1c240c4317" is_pre_election: true
I20260811 00:54:19.473048 29526 raft_consensus.cc:2454] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5497e09008ba44fd826cc9863d81fa28 in term 0.
I20260811 00:54:19.473052 28943 leader_election.cc:302] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5497e09008ba44fd826cc9863d81fa28, e08a375eaae94e6697d6585f4cbf23e3; no voters:
I20260811 00:54:19.473181 29636 raft_consensus.cc:2781] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:19.473232 29636 raft_consensus.cc:482] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:19.473259 29636 raft_consensus.cc:3037] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:19.473948 29636 raft_consensus.cc:504] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.474069 29636 leader_election.cc:288] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [CANDIDATE]: Term 1 election: Requested vote from peers a070c226578e41d29f305b1c240c4317 (127.26.99.131:46465), e08a375eaae94e6697d6585f4cbf23e3 (127.26.99.130:40667)
I20260811 00:54:19.474222 29526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2ae4eff7b840ca8f7c593474f83adc" candidate_uuid: "5497e09008ba44fd826cc9863d81fa28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a070c226578e41d29f305b1c240c4317"
I20260811 00:54:19.474298 29526 raft_consensus.cc:3037] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:19.475000 29526 raft_consensus.cc:2454] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5497e09008ba44fd826cc9863d81fa28 in term 1.
I20260811 00:54:19.475097 29295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f2ae4eff7b840ca8f7c593474f83adc" candidate_uuid: "5497e09008ba44fd826cc9863d81fa28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e08a375eaae94e6697d6585f4cbf23e3"
I20260811 00:54:19.475167 28944 leader_election.cc:302] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5497e09008ba44fd826cc9863d81fa28, a070c226578e41d29f305b1c240c4317; no voters:
I20260811 00:54:19.475172 29295 raft_consensus.cc:3037] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:19.475256 29636 raft_consensus.cc:2781] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:19.475390 29636 raft_consensus.cc:686] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [term 1 LEADER]: Becoming Leader. State: Replica: 5497e09008ba44fd826cc9863d81fa28, State: Running, Role: LEADER
I20260811 00:54:19.475492 29636 consensus_queue.cc:237] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } }
I20260811 00:54:19.475947 29295 raft_consensus.cc:2454] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5497e09008ba44fd826cc9863d81fa28 in term 1.
I20260811 00:54:19.476388 28791 catalog_manager.cc:5495] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5497e09008ba44fd826cc9863d81fa28 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "5497e09008ba44fd826cc9863d81fa28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5497e09008ba44fd826cc9863d81fa28" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 39663 } health_report { overall_health: HEALTHY } } }
I20260811 00:54:19.500213 29627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.497903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42654 (local address 127.26.99.129:39663)
0811 00:54:19.497965 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:19.497967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:19.497973 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:54:19.498010 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:19.498010 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:19.498031 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:19.498092 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:19.498224 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.498731 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.499473 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:19.499671 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:19.499728 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:19.499881 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:19.499974 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:19.500062 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:19.500110 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:54:19.500121 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 00:54:19.502100 29295 raft_consensus.cc:1261] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 1 FOLLOWER]: Refusing update from remote peer 5497e09008ba44fd826cc9863d81fa28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:19.502104 29526 raft_consensus.cc:1261] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 1 FOLLOWER]: Refusing update from remote peer 5497e09008ba44fd826cc9863d81fa28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:19.502463 29636 consensus_queue.cc:1035] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a070c226578e41d29f305b1c240c4317" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 46465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:19.502604 29641 consensus_queue.cc:1035] T 9f2ae4eff7b840ca8f7c593474f83adc P 5497e09008ba44fd826cc9863d81fa28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e08a375eaae94e6697d6585f4cbf23e3" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 40667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:19.504868 29648 mvcc.cc:205] Tried to move back new op lower bound from 7317133965317627904 to 7317133965212172288. Current Snapshot: MvccSnapshot[applied={T|T < 7317133965317627904}]
I20260811 00:54:19.505566 29649 mvcc.cc:205] Tried to move back new op lower bound from 7317133965317627904 to 7317133965212172288. Current Snapshot: MvccSnapshot[applied={T|T < 7317133965317627904}]
I20260811 00:54:19.507329 28791 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:19.507426 28791 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:19.508105 28791 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49421119783d4473ac9fdd209a843399: Sending DeleteTablet for 3 replicas of tablet 9f2ae4eff7b840ca8f7c593474f83adc
I20260811 00:54:19.508515 29029 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:19 UTC) from {username='slave'} at 127.0.0.1:42652
I20260811 00:54:19.508533 29499 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:19 UTC) from {username='slave'} at 127.0.0.1:47296
I20260811 00:54:19.508752 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28916
I20260811 00:54:19.508749 29264 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f2ae4eff7b840ca8f7c593474f83adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:19 UTC) from {username='slave'} at 127.0.0.1:38178
I20260811 00:54:19.516726 29668 tablet_replica.cc:330] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: stopping tablet replica
I20260811 00:54:19.519083 29668 raft_consensus.cc:2229] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:19.519335 29668 raft_consensus.cc:2258] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:19.519999 29668 ts_tablet_manager.cc:1905] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:19.522347 29668 ts_tablet_manager.cc:1918] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:19.522578 29668 log.cc:1196] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/9f2ae4eff7b840ca8f7c593474f83adc
I20260811 00:54:19.522886 29666 tablet_replica.cc:330] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: stopping tablet replica
I20260811 00:54:19.522984 29668 ts_tablet_manager.cc:1939] T 9f2ae4eff7b840ca8f7c593474f83adc P e08a375eaae94e6697d6585f4cbf23e3: Deleting consensus metadata
I20260811 00:54:19.523015 29666 raft_consensus.cc:2229] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:19.523138 29666 raft_consensus.cc:2258] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:19.523473 28770 catalog_manager.cc:4841] TS e08a375eaae94e6697d6585f4cbf23e3 (127.26.99.130:40667): tablet 9f2ae4eff7b840ca8f7c593474f83adc (table test-table [id=b291ccb31dd7405685cfeb7d957dbfe7]) successfully deleted
I20260811 00:54:19.523586 29666 ts_tablet_manager.cc:1905] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:19.524854 29666 ts_tablet_manager.cc:1918] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:19.524927 29666 log.cc:1196] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/9f2ae4eff7b840ca8f7c593474f83adc
I20260811 00:54:19.525126 29666 ts_tablet_manager.cc:1939] T 9f2ae4eff7b840ca8f7c593474f83adc P a070c226578e41d29f305b1c240c4317: Deleting consensus metadata
I20260811 00:54:19.525532 28772 catalog_manager.cc:4841] TS a070c226578e41d29f305b1c240c4317 (127.26.99.131:46465): tablet 9f2ae4eff7b840ca8f7c593474f83adc (table test-table [id=b291ccb31dd7405685cfeb7d957dbfe7]) successfully deleted
W20260811 00:54:19.528914 28770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:39663 (error 108)
I20260811 00:54:19.529155 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29140
I20260811 00:54:19.529413 29623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:19.529286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:39663 (local address 127.0.0.1:42658)
0811 00:54:19.529340 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:19.529378 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:39663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 00:54:19.533578 28770 catalog_manager.cc:4584] TS 5497e09008ba44fd826cc9863d81fa28 (127.26.99.129:39663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9f2ae4eff7b840ca8f7c593474f83adc: Network error: Client connection negotiation failed: client connection to 127.26.99.129:39663: connect: Connection refused (error 111)
I20260811 00:54:19.540881 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29375
I20260811 00:54:19.550881 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 28737
2026-08-11T00:54:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (776 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:19 dist-test-slave-xt4k krb5kdc[29675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:19 dist-test-slave-xt4k krb5kdc[29675](info): set up 2 sockets
Aug 11 00:54:19 dist-test-slave-xt4k krb5kdc[29675](info): commencing operation
krb5kdc: starting...
W20260811 00:54:20.730646 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:20 dist-test-slave-xt4k krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:20.848106 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:42925
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:42925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:20.929836 29707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:20.930045 29707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:20.930075 29707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:20.931191 29707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:20.931231 29707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:20.931249 29707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:20.931265 29707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:20.931280 29707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:20.932788 29707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:42925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:42925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:20.933035 29707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:20.933233 29707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:20.937805 29720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:20.937815 29718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:20.937815 29716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:20.937844 29707 server_base.cc:1034] running on GCE node
I20260811 00:54:20.938210 29707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:20.938464 29707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:20.939610 29707 hybrid_clock.cc:648] HybridClock initialized: now 1786409660939591 us; error 29 us; skew 500 ppm
Aug 11 00:54:20 dist-test-slave-xt4k krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:20.941985 29707 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:20.942414 29707 webserver.cc:460] Webserver started at http://127.26.99.190:46369/ using document root <none> and password file <none>
I20260811 00:54:20.942624 29707 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:20.942672 29707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:20.942795 29707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:20.943768 29707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "2ccb831d647c4fc3a85c10caa051642a"
format_stamp: "Formatted at 2026-08-11 00:54:20 on dist-test-slave-xt4k"
server_key: "22c52bc9e7a6223042c868e95389fbb1"
server_key_iv: "0a5f99c9fafa5b7bf934f720cf4fed5a"
server_key_version: "encryptionkey@0"
I20260811 00:54:20.944092 29707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "2ccb831d647c4fc3a85c10caa051642a"
format_stamp: "Formatted at 2026-08-11 00:54:20 on dist-test-slave-xt4k"
server_key: "22c52bc9e7a6223042c868e95389fbb1"
server_key_iv: "0a5f99c9fafa5b7bf934f720cf4fed5a"
server_key_version: "encryptionkey@0"
I20260811 00:54:20.945410 29707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:20.946175 29736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:20.946362 29707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:20.946487 29707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "2ccb831d647c4fc3a85c10caa051642a"
format_stamp: "Formatted at 2026-08-11 00:54:20 on dist-test-slave-xt4k"
server_key: "22c52bc9e7a6223042c868e95389fbb1"
server_key_iv: "0a5f99c9fafa5b7bf934f720cf4fed5a"
server_key_version: "encryptionkey@0"
I20260811 00:54:20.946548 29707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:20.954965 29707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:20.956924 29707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:20.957062 29707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:20.960711 29707 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:42925
I20260811 00:54:20.960745 29833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:42925 every 8 connection(s)
I20260811 00:54:20.961051 29707 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:20.961846 29834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:20.963269 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29707
I20260811 00:54:20.963388 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:20.963593 27022 external_mini_cluster.cc:1428] Setting key 08ef01e3cd8c081a68e242c379a3d19b
I20260811 00:54:20.964424 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: Bootstrap starting.
I20260811 00:54:20.965008 29834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:20.965325 29834 log.cc:824] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:20.965996 29834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: No bootstrap required, opened a new log
I20260811 00:54:20.967728 29834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } }
I20260811 00:54:20.967861 29834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:20.967895 29834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ccb831d647c4fc3a85c10caa051642a, State: Initialized, Role: FOLLOWER
I20260811 00:54:20.968039 29834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } }
I20260811 00:54:20.968128 29834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:20.968165 29834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:20.968214 29834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:20.968832 29834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } }
I20260811 00:54:20.968924 29834 leader_election.cc:302] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ccb831d647c4fc3a85c10caa051642a; no voters:
I20260811 00:54:20.969090 29834 leader_election.cc:288] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:20.969126 29842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:20.969233 29842 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [term 1 LEADER]: Becoming Leader. State: Replica: 2ccb831d647c4fc3a85c10caa051642a, State: Running, Role: LEADER
I20260811 00:54:20.969313 29842 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } }
I20260811 00:54:20.969348 29834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:20.969635 29847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ccb831d647c4fc3a85c10caa051642a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } } }
Aug 11 00:54:20 dist-test-slave-xt4k krb5kdc[29675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:20.969723 29847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:20.969903 29850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ccb831d647c4fc3a85c10caa051642a. Latest consensus state: current_term: 1 leader_uuid: "2ccb831d647c4fc3a85c10caa051642a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccb831d647c4fc3a85c10caa051642a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 42925 } } }
I20260811 00:54:20.969972 29850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:20.970094 29858 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:20.970578 29858 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:20.973088 29858 catalog_manager.cc:1347] Generated new cluster ID: 103cc034f890466ba1cc7d7572d08391
I20260811 00:54:20.973143 29858 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:20.973774 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:20.964102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.26.99.190:42925)
0811 00:54:20.964271 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:20.964278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:20.964301 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:54:20.964785 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:20.964793 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:20.964840 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:20.964963 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:20.965709 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:20.966645 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:20.967342 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:20.967750 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:20.967847 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:20.970277 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:20.970281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:20.970281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:20.970293 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:20.972019 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:20.972434 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:20.972437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:20.972438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:20.972559 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:20.972871 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:20.972872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:20.972873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:20.973155 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:20.973280 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:20.973488 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 00:54:20.973621 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260811 00:54:20.995281 29858 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:20.995813 29858 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:20.998045 29858 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: Generated new TSK 0
I20260811 00:54:20.998210 29858 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.99.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
Entry for principal kudu/127.26.99.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab.
I20260811 00:54:21.031967 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:21.119592 29888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:21.119803 29888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:21.119827 29888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:21.120972 29888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:21.121017 29888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:21.121043 29888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:21.122489 29888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.129.keytab
--principal=kudu/127.26.99.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:21.122682 29888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:21.122876 29888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:21.127698 29901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.127751 29888 server_base.cc:1034] running on GCE node
W20260811 00:54:21.127724 29904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.127720 29906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.128093 29888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:21.128324 29888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:21.129505 29888 hybrid_clock.cc:648] HybridClock initialized: now 1786409661129490 us; error 31 us; skew 500 ppm
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:21.131983 29888 init.cc:377] Logged in from keytab as kudu/127.26.99.129@KRBTEST.COM (short username kudu)
I20260811 00:54:21.132426 29888 webserver.cc:460] Webserver started at http://127.26.99.129:45003/ using document root <none> and password file <none>
I20260811 00:54:21.132628 29888 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:21.132675 29888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:21.132903 29888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:21.133952 29888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "4815b08ad9bb4a219f59f193b8e6ed6c"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "32c396c88148ccad8b5508c04916e765"
server_key_iv: "31471a5e7e91b79cc9e6896723f1f430"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.134286 29888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "4815b08ad9bb4a219f59f193b8e6ed6c"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "32c396c88148ccad8b5508c04916e765"
server_key_iv: "31471a5e7e91b79cc9e6896723f1f430"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.135576 29888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:54:21.136420 29914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.136575 29888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:21.136663 29888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "4815b08ad9bb4a219f59f193b8e6ed6c"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "32c396c88148ccad8b5508c04916e765"
server_key_iv: "31471a5e7e91b79cc9e6896723f1f430"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.136735 29888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:21.153313 29888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:21.155331 29888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:21.155490 29888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:21.155714 29888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:21.156020 29888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:21.156054 29888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.156085 29888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:21.156107 29888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.161875 29888 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:42993
I20260811 00:54:21.161936 30124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:42993 every 8 connection(s)
I20260811 00:54:21.162235 29888 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.129@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:21.168248 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 29888
I20260811 00:54:21.168391 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:21.168591 27022 external_mini_cluster.cc:1428] Setting key 18e9bce2ab62e687a17f22ea633ccd4f
I20260811 00:54:21.171772 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.162929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:59369 (local address 127.26.99.190:42925)
0811 00:54:21.163006 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.163008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.163165 (+ 157us) server_negotiation.cc:407] Connection header received
0811 00:54:21.163676 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.163678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.163689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.163749 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.164711 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.165226 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.166221 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.166440 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.166516 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.168819 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.168821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.168821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:21.168829 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.170133 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.170673 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.170674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.170674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.170728 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.171076 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.171077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.171078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.171208 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.171274 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.171611 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.171700 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:54:21.171981 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.162873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:42925 (local address 127.26.99.129:59369)
0811 00:54:21.163032 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.163071 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.163566 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.163812 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.163815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.164396 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:21.164603 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.164607 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.165314 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.165315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.166139 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.166141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.166565 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.166567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.166683 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.167140 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:21.167147 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:21.168652 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:21.170224 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.170232 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.170235 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.170604 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.170829 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.170830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.170831 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.170987 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.171275 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:21.171281 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:21.171450 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.171585 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.171759 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260811 00:54:21.172567 30126 heartbeater.cc:347] Connected to a master server at 127.26.99.190:42925
I20260811 00:54:21.172673 30126 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:21.172857 30126 heartbeater.cc:511] Master 127.26.99.190:42925 requested a full tablet report, sending...
I20260811 00:54:21.173403 29779 ts_manager.cc:194] Registered new tserver with Master: 4815b08ad9bb4a219f59f193b8e6ed6c (127.26.99.129:42993)
I20260811 00:54:21.174074 29779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.129@KRBTEST.COM'} at 127.26.99.129:59369
WARNING: no policy specified for kudu/127.26.99.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
Entry for principal kudu/127.26.99.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab.
I20260811 00:54:21.194624 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:21.275385 30136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:21.275585 30136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:21.275607 30136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:21.276783 30136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:21.276825 30136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:21.276850 30136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:21.278282 30136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.130.keytab
--principal=kudu/127.26.99.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:21.278494 30136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:21.278702 30136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:21.283622 30154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.283625 30149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.283603 30147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.283644 30136 server_base.cc:1034] running on GCE node
I20260811 00:54:21.283998 30136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:21.284229 30136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:21.285395 30136 hybrid_clock.cc:648] HybridClock initialized: now 1786409661285392 us; error 42 us; skew 500 ppm
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:21.287899 30136 init.cc:377] Logged in from keytab as kudu/127.26.99.130@KRBTEST.COM (short username kudu)
I20260811 00:54:21.288318 30136 webserver.cc:460] Webserver started at http://127.26.99.130:38573/ using document root <none> and password file <none>
I20260811 00:54:21.288545 30136 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:21.288594 30136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:21.288719 30136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:21.289727 30136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "d2d57575a6ea475d906e0c09986427fc"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "a9fbaf56c80b68afec17f5d9e0ac8375"
server_key_iv: "8566c9985511babf079237d363286fc1"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.290068 30136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "d2d57575a6ea475d906e0c09986427fc"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "a9fbaf56c80b68afec17f5d9e0ac8375"
server_key_iv: "8566c9985511babf079237d363286fc1"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.291290 30136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:21.291997 30163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.292158 30136 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:21.292241 30136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "d2d57575a6ea475d906e0c09986427fc"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "a9fbaf56c80b68afec17f5d9e0ac8375"
server_key_iv: "8566c9985511babf079237d363286fc1"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.292302 30136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:21.311684 30136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:21.313510 30136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:21.313648 30136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:21.313850 30136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:21.314133 30136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:21.314167 30136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.314193 30136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:21.314210 30136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.319486 30136 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:44111
I20260811 00:54:21.319546 30393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:44111 every 8 connection(s)
I20260811 00:54:21.319826 30136 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.130@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:21.328478 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.320484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:55151 (local address 127.26.99.190:42925)
0811 00:54:21.320547 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.320550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.320730 (+ 180us) server_negotiation.cc:407] Connection header received
0811 00:54:21.321209 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.321210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.321223 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.321275 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.322197 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.322720 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.323669 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.323877 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.323933 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.325930 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.325931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.325932 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:21.325939 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.327158 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.327573 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.327575 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.327575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.327634 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.327844 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.327845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.327846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.327967 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.328024 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.328274 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.328387 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 00:54:21.328644 30403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.320446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:42925 (local address 127.26.99.130:55151)
0811 00:54:21.320617 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.320652 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.321115 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.321338 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.321342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.321904 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:21.322101 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.322106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.322807 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.322808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.323585 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.323587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.323945 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.323946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.324063 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.324587 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:21.324595 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:21.325842 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:21.327258 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.327264 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.327267 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.327504 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.327689 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.327690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.327690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.327788 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.328022 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:21.328029 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:21.328158 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.328244 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.328439 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260811 00:54:21.329111 30399 heartbeater.cc:347] Connected to a master server at 127.26.99.190:42925
I20260811 00:54:21.329210 30399 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:21.329389 30399 heartbeater.cc:511] Master 127.26.99.190:42925 requested a full tablet report, sending...
I20260811 00:54:21.329770 29779 ts_manager.cc:194] Registered new tserver with Master: d2d57575a6ea475d906e0c09986427fc (127.26.99.130:44111)
I20260811 00:54:21.329952 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30136
I20260811 00:54:21.330054 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:21.330189 29779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.130@KRBTEST.COM'} at 127.26.99.130:55151
I20260811 00:54:21.330230 27022 external_mini_cluster.cc:1428] Setting key 83d1857ce2214285c63ddff3ca86a95f
WARNING: no policy specified for kudu/127.26.99.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
Entry for principal kudu/127.26.99.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab.
I20260811 00:54:21.353106 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:44023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:21.433145 30406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:21.433329 30406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:21.433351 30406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:21.434444 30406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:21.434485 30406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:21.434510 30406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:21.435926 30406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:44023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.131.keytab
--principal=kudu/127.26.99.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:42925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:21.436177 30406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:21.436477 30406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:21.441288 30416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.441313 30421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.441275 30415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.441326 30406 server_base.cc:1034] running on GCE node
I20260811 00:54:21.441744 30406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:21.441957 30406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:21.443110 30406 hybrid_clock.cc:648] HybridClock initialized: now 1786409661443096 us; error 28 us; skew 500 ppm
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:21.445603 30406 init.cc:377] Logged in from keytab as kudu/127.26.99.131@KRBTEST.COM (short username kudu)
I20260811 00:54:21.446031 30406 webserver.cc:460] Webserver started at http://127.26.99.131:42307/ using document root <none> and password file <none>
I20260811 00:54:21.446266 30406 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:21.446310 30406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:21.446408 30406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:21.447359 30406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "3dda7c5de5c94e11bacd0bc418f06e02"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "196860de9ccc2d69b551c87321d66030"
server_key_iv: "01ea61c3af3f52b3d36cc769e9fa54cc"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.447651 30406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "3dda7c5de5c94e11bacd0bc418f06e02"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "196860de9ccc2d69b551c87321d66030"
server_key_iv: "01ea61c3af3f52b3d36cc769e9fa54cc"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.448884 30406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:21.449553 30434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.449739 30406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:21.449805 30406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "3dda7c5de5c94e11bacd0bc418f06e02"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "196860de9ccc2d69b551c87321d66030"
server_key_iv: "01ea61c3af3f52b3d36cc769e9fa54cc"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.449856 30406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:21.468209 30406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:21.470564 30406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:21.470708 30406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:21.470947 30406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:21.471282 30406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:21.471323 30406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.471354 30406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:21.471376 30406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.477180 30406 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38557
I20260811 00:54:21.477238 30652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38557 every 8 connection(s)
I20260811 00:54:21.477566 30406 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
Aug 11 00:54:21 dist-test-slave-xt4k krb5kdc[29675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.131@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:21.486485 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.478389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:45169 (local address 127.26.99.190:42925)
0811 00:54:21.478490 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.478493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.478582 (+ 89us) server_negotiation.cc:407] Connection header received
0811 00:54:21.479082 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.479083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.479095 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.479154 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.480100 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.480725 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.481728 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.481921 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.481979 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.483977 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.483979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.483979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:21.483985 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.485288 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.485694 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.485695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.485696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.485753 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.485996 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.485997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.485997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.486094 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.486141 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.486351 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.486411 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 00:54:21.486683 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.478290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:42925 (local address 127.26.99.131:45169)
0811 00:54:21.478447 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.478486 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.478982 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.479205 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.479208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.479792 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:21.479993 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.479998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.480832 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.480833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.481645 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.481648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.481986 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.481987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.482092 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.482559 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:21.482568 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:21.483891 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:21.485368 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.485374 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.485395 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.485619 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.485832 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:21.485833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:21.485833 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:21.485945 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:21.486137 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:21.486141 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:21.486253 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.486330 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.486455 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260811 00:54:21.487145 30653 heartbeater.cc:347] Connected to a master server at 127.26.99.190:42925
I20260811 00:54:21.487234 30653 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:21.487378 30653 heartbeater.cc:511] Master 127.26.99.190:42925 requested a full tablet report, sending...
I20260811 00:54:21.487641 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30406
I20260811 00:54:21.487735 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:21.487779 29779 ts_manager.cc:194] Registered new tserver with Master: 3dda7c5de5c94e11bacd0bc418f06e02 (127.26.99.131:38557)
I20260811 00:54:21.487901 27022 external_mini_cluster.cc:1428] Setting key 33424af4b6e607439f7be2590bfc4a1a
I20260811 00:54:21.488242 29779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.99.131@KRBTEST.COM'} at 127.26.99.131:45169
I20260811 00:54:21.488781 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:21.495362 29838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.490131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49666 (local address 127.26.99.190:42925)
0811 00:54:21.490197 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.490199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.490258 (+ 59us) server_negotiation.cc:407] Connection header received
0811 00:54:21.490302 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.490303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.490315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.490369 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.490834 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.491300 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.491957 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.492131 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.492181 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.493189 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.493190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.493191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:21.493197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.494325 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.494630 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.494631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.494631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.494675 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:21.494904 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:21.494906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:21.494906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:21.495071 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.495162 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.495233 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.495298 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:54:21.497092 29779 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49666:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:21.498812 29779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:21.505210 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38557 (local address 127.0.0.1:60500)
0811 00:54:21.501535 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.501545 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.501612 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.501939 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.501940 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.501942 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:21.501998 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.502000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.502885 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.502886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.503744 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.503746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.504878 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.504879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.504973 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.504987 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.505060 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.505122 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260811 00:54:21.505528 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60500 (local address 127.26.99.131:38557)
0811 00:54:21.501497 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.501501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.501608 (+ 107us) server_negotiation.cc:407] Connection header received
0811 00:54:21.501718 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.501720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.501736 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.501807 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:21.502087 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.502789 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.503894 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.504696 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.504772 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.504837 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.505401 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.505451 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260811 00:54:21.505616 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:44111 (local address 127.0.0.1:41498)
0811 00:54:21.501600 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.501609 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.501662 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.501872 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.501873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.501875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:21.501922 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.501923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.503202 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.503203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.504436 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.504438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.505396 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.505397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.505456 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.505461 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.505507 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.505546 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260811 00:54:21.505789 30673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:42993 (local address 127.0.0.1:44102)
0811 00:54:21.501210 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.501249 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.501314 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.501515 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.501518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.501520 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:21.501588 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.501591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.502911 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.502912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.504255 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.504258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.505595 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.505596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.505650 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.505653 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.505698 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.505733 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":64,"thread_start_us":48,"threads_started":1}
I20260811 00:54:21.505844 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.26.99.130:44111)
0811 00:54:21.501484 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.501488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.501675 (+ 187us) server_negotiation.cc:407] Connection header received
0811 00:54:21.501718 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.501720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.501736 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.501803 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:21.502047 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.503100 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.504518 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.505242 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.505310 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.505360 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.505726 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.505768 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":77,"threads_started":1}
I20260811 00:54:21.506054 30679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.501165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.26.99.129:42993)
0811 00:54:21.501365 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.501370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.501380 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:21.501418 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.501420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.501433 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.501498 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:21.501675 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.502797 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.504427 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.505437 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.505510 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.505563 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.505952 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.505995 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":89,"threads_started":1}
I20260811 00:54:21.506323 30520 tablet_service.cc:1467] Processing CreateTablet for tablet efa609bcdfc94d378d4b79ae524e8eac (DEFAULT_TABLE table=test-table [id=aeca7a04cce04567a17ba62c9b637f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:21.506728 30520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa609bcdfc94d378d4b79ae524e8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:21.506717 30003 tablet_service.cc:1467] Processing CreateTablet for tablet efa609bcdfc94d378d4b79ae524e8eac (DEFAULT_TABLE table=test-table [id=aeca7a04cce04567a17ba62c9b637f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:21.507069 30003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa609bcdfc94d378d4b79ae524e8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:21.508905 30253 tablet_service.cc:1467] Processing CreateTablet for tablet efa609bcdfc94d378d4b79ae524e8eac (DEFAULT_TABLE table=test-table [id=aeca7a04cce04567a17ba62c9b637f15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:21.509208 30253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa609bcdfc94d378d4b79ae524e8eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:21.510385 30685 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Bootstrap starting.
I20260811 00:54:21.510962 30685 tablet_bootstrap.cc:654] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:21.511402 30685 log.cc:824] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:21.511725 30684 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: Bootstrap starting.
I20260811 00:54:21.511864 30690 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Bootstrap starting.
I20260811 00:54:21.512136 30685 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: No bootstrap required, opened a new log
I20260811 00:54:21.512209 30685 ts_tablet_manager.cc:1397] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:21.512404 30684 tablet_bootstrap.cc:654] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:21.512482 30690 tablet_bootstrap.cc:654] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:21.512938 30690 log.cc:824] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:21.512970 30684 log.cc:824] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:21.513628 30690 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: No bootstrap required, opened a new log
I20260811 00:54:21.513695 30690 ts_tablet_manager.cc:1397] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:54:21.513710 30684 tablet_bootstrap.cc:492] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: No bootstrap required, opened a new log
I20260811 00:54:21.513768 30684 ts_tablet_manager.cc:1397] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:54:21.514153 30685 raft_consensus.cc:348] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.514321 30685 raft_consensus.cc:374] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:21.514353 30685 raft_consensus.cc:729] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dda7c5de5c94e11bacd0bc418f06e02, State: Initialized, Role: FOLLOWER
I20260811 00:54:21.514478 30685 consensus_queue.cc:260] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.514756 30685 ts_tablet_manager.cc:1428] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:54:21.514791 30653 heartbeater.cc:503] Master 127.26.99.190:42925 was elected leader, sending a full tablet report...
I20260811 00:54:21.515125 30690 raft_consensus.cc:348] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.515264 30690 raft_consensus.cc:374] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:21.515285 30690 raft_consensus.cc:729] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2d57575a6ea475d906e0c09986427fc, State: Initialized, Role: FOLLOWER
I20260811 00:54:21.515368 30690 consensus_queue.cc:260] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.515617 30690 ts_tablet_manager.cc:1428] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 00:54:21.515825 30399 heartbeater.cc:503] Master 127.26.99.190:42925 was elected leader, sending a full tablet report...
I20260811 00:54:21.516033 30684 raft_consensus.cc:348] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.516188 30684 raft_consensus.cc:374] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:21.516235 30684 raft_consensus.cc:729] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4815b08ad9bb4a219f59f193b8e6ed6c, State: Initialized, Role: FOLLOWER
I20260811 00:54:21.516369 30684 consensus_queue.cc:260] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.516671 30684 ts_tablet_manager.cc:1428] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 00:54:21.516710 30126 heartbeater.cc:503] Master 127.26.99.190:42925 was elected leader, sending a full tablet report...
I20260811 00:54:21.533707 30700 raft_consensus.cc:482] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:21.533834 30700 raft_consensus.cc:504] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.534168 30700 leader_election.cc:288] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dda7c5de5c94e11bacd0bc418f06e02 (127.26.99.131:38557), d2d57575a6ea475d906e0c09986427fc (127.26.99.130:44111)
I20260811 00:54:21.537020 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.534438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:43029 (local address 127.26.99.131:38557)
0811 00:54:21.534484 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.534486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.534494 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:21.534523 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.534524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.534533 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.534591 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:21.534782 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.535303 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536274 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.536701 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536768 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.536777 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.536916 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.536954 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:54:21.537020 30130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.534338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38557 (local address 127.26.99.129:43029)
0811 00:54:21.534389 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.534402 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.534443 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.534631 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.534632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.534635 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:21.534704 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.534705 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.535411 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.535412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.536186 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.536188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.536772 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.536848 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.536851 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.536897 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.536942 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":28}
I20260811 00:54:21.537093 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.534422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:34321 (local address 127.26.99.130:44111)
0811 00:54:21.534476 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.534478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.534752 (+ 274us) server_negotiation.cc:407] Connection header received
0811 00:54:21.534784 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.534785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.534794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.534847 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:21.534980 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.535447 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536389 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.536776 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536838 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.536846 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.536979 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.537017 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:54:21.537181 30701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.534340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:44111 (local address 127.26.99.129:34321)
0811 00:54:21.534685 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.534695 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.534741 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.534852 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.534853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.534854 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:21.534925 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.534927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.535522 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.535523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.536286 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.536288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.536845 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.536846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.536921 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.536925 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.536968 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.537008 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":148,"thread_start_us":121,"threads_started":1}
I20260811 00:54:21.537408 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa609bcdfc94d378d4b79ae524e8eac" candidate_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" is_pre_election: true
I20260811 00:54:21.537496 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa609bcdfc94d378d4b79ae524e8eac" candidate_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d57575a6ea475d906e0c09986427fc" is_pre_election: true
I20260811 00:54:21.537606 30548 raft_consensus.cc:2454] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4815b08ad9bb4a219f59f193b8e6ed6c in term 0.
I20260811 00:54:21.537645 30292 raft_consensus.cc:2454] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4815b08ad9bb4a219f59f193b8e6ed6c in term 0.
I20260811 00:54:21.537849 29920 leader_election.cc:302] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4815b08ad9bb4a219f59f193b8e6ed6c, d2d57575a6ea475d906e0c09986427fc; no voters:
I20260811 00:54:21.538003 30700 raft_consensus.cc:2781] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:21.538053 30700 raft_consensus.cc:482] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:21.538076 30700 raft_consensus.cc:3037] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:21.538769 30700 raft_consensus.cc:504] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.538898 30700 leader_election.cc:288] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [CANDIDATE]: Term 1 election: Requested vote from peers 3dda7c5de5c94e11bacd0bc418f06e02 (127.26.99.131:38557), d2d57575a6ea475d906e0c09986427fc (127.26.99.130:44111)
I20260811 00:54:21.539062 30548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa609bcdfc94d378d4b79ae524e8eac" candidate_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dda7c5de5c94e11bacd0bc418f06e02"
I20260811 00:54:21.539068 30292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa609bcdfc94d378d4b79ae524e8eac" candidate_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2d57575a6ea475d906e0c09986427fc"
I20260811 00:54:21.539137 30548 raft_consensus.cc:3037] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:21.539140 30292 raft_consensus.cc:3037] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:21.539868 30292 raft_consensus.cc:2454] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4815b08ad9bb4a219f59f193b8e6ed6c in term 1.
I20260811 00:54:21.539904 30548 raft_consensus.cc:2454] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4815b08ad9bb4a219f59f193b8e6ed6c in term 1.
I20260811 00:54:21.540047 29920 leader_election.cc:302] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4815b08ad9bb4a219f59f193b8e6ed6c, d2d57575a6ea475d906e0c09986427fc; no voters:
I20260811 00:54:21.540154 30700 raft_consensus.cc:2781] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:21.540313 30700 raft_consensus.cc:686] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [term 1 LEADER]: Becoming Leader. State: Replica: 4815b08ad9bb4a219f59f193b8e6ed6c, State: Running, Role: LEADER
I20260811 00:54:21.540431 30700 consensus_queue.cc:237] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } }
I20260811 00:54:21.541251 29777 catalog_manager.cc:5495] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4815b08ad9bb4a219f59f193b8e6ed6c (127.26.99.129). New cstate: current_term: 1 leader_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4815b08ad9bb4a219f59f193b8e6ed6c" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 42993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 } health_report { overall_health: UNKNOWN } } }
I20260811 00:54:21.551744 30679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.549031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44106 (local address 127.26.99.129:42993)
0811 00:54:21.549085 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.549087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.549097 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:21.549140 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.549141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.549158 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.549212 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:21.549349 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.549849 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.550867 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.551243 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.551305 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.551450 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:21.551555 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:21.551621 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.551657 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.551677 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 00:54:21.553521 30292 raft_consensus.cc:1261] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 1 FOLLOWER]: Refusing update from remote peer 4815b08ad9bb4a219f59f193b8e6ed6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:21.553521 30548 raft_consensus.cc:1261] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 1 FOLLOWER]: Refusing update from remote peer 4815b08ad9bb4a219f59f193b8e6ed6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:21.553862 30702 consensus_queue.cc:1035] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2d57575a6ea475d906e0c09986427fc" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:21.553994 30700 consensus_queue.cc:1035] T efa609bcdfc94d378d4b79ae524e8eac P 4815b08ad9bb4a219f59f193b8e6ed6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dda7c5de5c94e11bacd0bc418f06e02" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:21.556274 30706 mvcc.cc:205] Tried to move back new op lower bound from 7317133973720678400 to 7317133973670105088. Current Snapshot: MvccSnapshot[applied={T|T < 7317133973720678400}]
I20260811 00:54:21.556792 30707 mvcc.cc:205] Tried to move back new op lower bound from 7317133973720678400 to 7317133973670105088. Current Snapshot: MvccSnapshot[applied={T|T < 7317133973720678400}]
I20260811 00:54:21.558923 29777 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:21.559001 29777 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:21.559691 29777 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ccb831d647c4fc3a85c10caa051642a: Sending DeleteTablet for 3 replicas of tablet efa609bcdfc94d378d4b79ae524e8eac
I20260811 00:54:21.559988 30003 tablet_service.cc:1514] Processing DeleteTablet for tablet efa609bcdfc94d378d4b79ae524e8eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:21 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:44102
I20260811 00:54:21.560034 30520 tablet_service.cc:1514] Processing DeleteTablet for tablet efa609bcdfc94d378d4b79ae524e8eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:21 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:60500
I20260811 00:54:21.560221 30253 tablet_service.cc:1514] Processing DeleteTablet for tablet efa609bcdfc94d378d4b79ae524e8eac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:21 UTC) from {username='kudu', principal='kudu/127.26.99.190@KRBTEST.COM'} at 127.0.0.1:41498
I20260811 00:54:21.560360 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29888
I20260811 00:54:21.560595 30727 tablet_replica.cc:330] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: stopping tablet replica
I20260811 00:54:21.572716 30728 tablet_replica.cc:330] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: stopping tablet replica
I20260811 00:54:21.572945 30728 raft_consensus.cc:2229] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:21.573148 30728 raft_consensus.cc:2258] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:21.576319 30728 ts_tablet_manager.cc:1905] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:21.577775 30727 raft_consensus.cc:2229] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:21.577929 30727 raft_consensus.cc:2258] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:21.578193 30728 ts_tablet_manager.cc:1918] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:21.578274 30728 log.cc:1196] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/efa609bcdfc94d378d4b79ae524e8eac
I20260811 00:54:21.578543 30728 ts_tablet_manager.cc:1939] T efa609bcdfc94d378d4b79ae524e8eac P d2d57575a6ea475d906e0c09986427fc: Deleting consensus metadata
I20260811 00:54:21.579020 29748 catalog_manager.cc:4841] TS d2d57575a6ea475d906e0c09986427fc (127.26.99.130:44111): tablet efa609bcdfc94d378d4b79ae524e8eac (table test-table [id=aeca7a04cce04567a17ba62c9b637f15]) successfully deleted
I20260811 00:54:21.580044 30727 ts_tablet_manager.cc:1905] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:21.581326 30727 ts_tablet_manager.cc:1918] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:21.581386 30727 log.cc:1196] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/efa609bcdfc94d378d4b79ae524e8eac
I20260811 00:54:21.581634 30727 ts_tablet_manager.cc:1939] T efa609bcdfc94d378d4b79ae524e8eac P 3dda7c5de5c94e11bacd0bc418f06e02: Deleting consensus metadata
I20260811 00:54:21.582062 29745 catalog_manager.cc:4841] TS 3dda7c5de5c94e11bacd0bc418f06e02 (127.26.99.131:38557): tablet efa609bcdfc94d378d4b79ae524e8eac (table test-table [id=aeca7a04cce04567a17ba62c9b637f15]) successfully deleted
W20260811 00:54:21.584087 29742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:42993 (error 108)
I20260811 00:54:21.584282 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30136
I20260811 00:54:21.586959 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.584482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:42993 (local address 127.0.0.1:44114)
0811 00:54:21.586859 (+ 2377us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.586918 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:42993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2348}
W20260811 00:54:21.587121 29742 catalog_manager.cc:4584] TS 4815b08ad9bb4a219f59f193b8e6ed6c (127.26.99.129:42993): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet efa609bcdfc94d378d4b79ae524e8eac: Network error: Client connection negotiation failed: client connection to 127.26.99.129:42993: connect: Connection refused (error 111)
I20260811 00:54:21.593942 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30406
I20260811 00:54:21.607299 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 29707
2026-08-11T00:54:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2056 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T00:54:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:21Z Disabled control of system clock
I20260811 00:54:21.639071 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35481
--webserver_interface=127.26.99.190
--webserver_port=0
--builtin_ntp_servers=127.26.99.148:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:35481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:21.718495 30737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:21.718710 30737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:21.718730 30737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:21.719846 30737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:21.719885 30737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:21.719897 30737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:21.719908 30737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:21.719919 30737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:21.721266 30737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:35481
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:35481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:21.721493 30737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:21.721771 30737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:21.726732 30743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.726783 30747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.726732 30742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.727634 30737 server_base.cc:1034] running on GCE node
I20260811 00:54:21.727862 30737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:21.728124 30737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:21.729247 30737 hybrid_clock.cc:648] HybridClock initialized: now 1786409661729237 us; error 26 us; skew 500 ppm
I20260811 00:54:21.730518 30737 webserver.cc:460] Webserver started at http://127.26.99.190:36163/ using document root <none> and password file <none>
I20260811 00:54:21.730736 30737 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:21.730782 30737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:21.730911 30737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:21.732003 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "7cb748daffca4a28ab5f36573ea0625a"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "8d870910ad1a794e094ab074ed33900b"
server_key_iv: "057e2f2d7f9d8dccb15e44dce9b689fa"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.732353 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "7cb748daffca4a28ab5f36573ea0625a"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "8d870910ad1a794e094ab074ed33900b"
server_key_iv: "057e2f2d7f9d8dccb15e44dce9b689fa"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.733635 30737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:21.734360 30757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.734509 30737 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:21.734596 30737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "7cb748daffca4a28ab5f36573ea0625a"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "8d870910ad1a794e094ab074ed33900b"
server_key_iv: "057e2f2d7f9d8dccb15e44dce9b689fa"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.734661 30737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:21.759862 30737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:21.760186 30737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:21.760317 30737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:21.764199 30737 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:35481
I20260811 00:54:21.764235 30866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:35481 every 8 connection(s)
I20260811 00:54:21.764571 30737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:21.765491 30867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:21.767863 30867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: Bootstrap starting.
I20260811 00:54:21.768445 30867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:21.768709 30867 log.cc:824] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:21.769317 30867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: No bootstrap required, opened a new log
I20260811 00:54:21.770824 30867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } }
I20260811 00:54:21.770955 30867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:21.770977 30867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cb748daffca4a28ab5f36573ea0625a, State: Initialized, Role: FOLLOWER
I20260811 00:54:21.771083 30867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } }
I20260811 00:54:21.771159 30867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:21.771186 30867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:21.771216 30867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:21.771675 30867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } }
I20260811 00:54:21.771764 30867 leader_election.cc:302] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cb748daffca4a28ab5f36573ea0625a; no voters:
I20260811 00:54:21.771880 30867 leader_election.cc:288] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:21.771948 30875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:21.772102 30867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:21.772109 30875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [term 1 LEADER]: Becoming Leader. State: Replica: 7cb748daffca4a28ab5f36573ea0625a, State: Running, Role: LEADER
I20260811 00:54:21.772243 30875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } }
I20260811 00:54:21.772733 30878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cb748daffca4a28ab5f36573ea0625a. Latest consensus state: current_term: 1 leader_uuid: "7cb748daffca4a28ab5f36573ea0625a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } } }
I20260811 00:54:21.772818 30878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:21.773150 30877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cb748daffca4a28ab5f36573ea0625a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cb748daffca4a28ab5f36573ea0625a" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 35481 } } }
I20260811 00:54:21.773236 30877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:21.773316 30892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:21.773379 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30737
I20260811 00:54:21.773494 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:21.773694 27022 external_mini_cluster.cc:1428] Setting key a7ad233a8730536423609a5ec719ba21
I20260811 00:54:21.773802 30892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:21.775285 30892 catalog_manager.cc:1347] Generated new cluster ID: d337c8b517ff488eb29a3373444a7297
I20260811 00:54:21.775338 30892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:21.779588 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.774148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33218 (local address 127.26.99.190:35481)
0811 00:54:21.774335 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.774344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.774373 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:54:21.774488 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.774495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.774562 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.774714 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.775045 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.776409 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.777520 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.778131 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.778231 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.778916 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.778920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.778920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:21.779122 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.779162 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:21.779176 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.779232 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.779315 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.779390 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260811 00:54:21.784626 30892 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:21.785111 30892 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:21.787439 30892 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: Generated new TSK 0
I20260811 00:54:21.787590 30892 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:21.790217 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.129:0
--local_ip_for_outbound_sockets=127.26.99.129
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--builtin_ntp_servers=127.26.99.148:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:21.872772 30913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:21.873000 30913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:21.873034 30913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:21.874456 30913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:21.874523 30913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:21.874567 30913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.129
I20260811 00:54:21.876051 30913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.99.129
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.129
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:21.876295 30913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:21.876621 30913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:21.882602 30924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.882592 30920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:21.882589 30919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:21.882797 30913 server_base.cc:1034] running on GCE node
I20260811 00:54:21.883031 30913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:21.883291 30913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:21.884395 30913 hybrid_clock.cc:648] HybridClock initialized: now 1786409661884380 us; error 30 us; skew 500 ppm
I20260811 00:54:21.885637 30913 webserver.cc:460] Webserver started at http://127.26.99.129:35521/ using document root <none> and password file <none>
I20260811 00:54:21.885878 30913 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:21.885927 30913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:21.886050 30913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:21.887099 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data/instance:
uuid: "f36de87700b54d52bd154c2eb10dd529"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "03f5e4dc38f36394271df8692cc4c6df"
server_key_iv: "d36563c5ae3393b12b6a2b0ddb6be5d0"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.887425 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance:
uuid: "f36de87700b54d52bd154c2eb10dd529"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "03f5e4dc38f36394271df8692cc4c6df"
server_key_iv: "d36563c5ae3393b12b6a2b0ddb6be5d0"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.888681 30913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:21.889380 30937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.889551 30913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:21.889653 30913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal
uuid: "f36de87700b54d52bd154c2eb10dd529"
format_stamp: "Formatted at 2026-08-11 00:54:21 on dist-test-slave-xt4k"
server_key: "03f5e4dc38f36394271df8692cc4c6df"
server_key_iv: "d36563c5ae3393b12b6a2b0ddb6be5d0"
server_key_version: "encryptionkey@0"
I20260811 00:54:21.889724 30913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:21.910898 30913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:21.911195 30913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:21.911303 30913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:21.911505 30913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:21.911789 30913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:21.911818 30913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.911844 30913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:21.911859 30913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:21.917277 30913 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.129:35893
I20260811 00:54:21.917326 31157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.129:35893 every 8 connection(s)
I20260811 00:54:21.917655 30913 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/data/info.pb
I20260811 00:54:21.922655 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.918355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:50627 (local address 127.26.99.190:35481)
0811 00:54:21.918412 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:21.918414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:21.918618 (+ 204us) server_negotiation.cc:407] Connection header received
0811 00:54:21.919098 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:21.919099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:21.919110 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:21.919157 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:21.919818 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.920327 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.921262 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.921464 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.921525 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.922351 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:21.922352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:21.922352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:21.922357 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:21.922373 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:21.922388 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:21.922439 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:21.922563 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 00:54:21.922589 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 00:54:21.922962 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:21.918328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35481 (local address 127.26.99.129:50627)
0811 00:54:21.918505 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:21.918538 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:21.919021 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:21.919215 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:21.919218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:21.919227 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:21.919720 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.919725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.920409 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.920410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.921176 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:21.921178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:21.921567 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:21.921568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:21.921692 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:21.922204 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:21.922204 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:21.922234 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:21.922257 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:21.922449 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:21.922452 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:21.922455 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:21.922513 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:54:21.922595 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260811 00:54:21.923520 31158 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35481
I20260811 00:54:21.923630 31158 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:21.923815 31158 heartbeater.cc:511] Master 127.26.99.190:35481 requested a full tablet report, sending...
I20260811 00:54:21.924315 30792 ts_manager.cc:194] Registered new tserver with Master: f36de87700b54d52bd154c2eb10dd529 (127.26.99.129:35893)
I20260811 00:54:21.924924 30792 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.129:50627
I20260811 00:54:21.925973 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 30913
I20260811 00:54:21.926066 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-0/wal/instance
I20260811 00:54:21.926393 27022 external_mini_cluster.cc:1428] Setting key 29dfcef612d949be0d37d24306eeecf5
I20260811 00:54:21.927282 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.130:0
--local_ip_for_outbound_sockets=127.26.99.130
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--builtin_ntp_servers=127.26.99.148:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 00:54:22.011073 31161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:22.011276 31161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:22.011297 31161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:22.012414 31161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:22.012462 31161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:22.012495 31161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.130
I20260811 00:54:22.013861 31161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.99.130
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.130
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:22.014062 31161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:22.014325 31161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:22.019124 31176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:22.019156 31175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:22.019141 31178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:22.019183 31161 server_base.cc:1034] running on GCE node
I20260811 00:54:22.019541 31161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:22.019742 31161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:22.020879 31161 hybrid_clock.cc:648] HybridClock initialized: now 1786409662020868 us; error 27 us; skew 500 ppm
I20260811 00:54:22.022207 31161 webserver.cc:460] Webserver started at http://127.26.99.130:41041/ using document root <none> and password file <none>
I20260811 00:54:22.022498 31161 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:22.022548 31161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:22.022665 31161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:22.023689 31161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data/instance:
uuid: "d9d1787c64734a748fd9eeaeb1a6e22b"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "425c20e0dcba7c0e477fe89471c20bc8"
server_key_iv: "b12165a2cfa255468bd3c4bc09a4b5ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.023998 31161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance:
uuid: "d9d1787c64734a748fd9eeaeb1a6e22b"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "425c20e0dcba7c0e477fe89471c20bc8"
server_key_iv: "b12165a2cfa255468bd3c4bc09a4b5ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.025278 31161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:22.026036 31189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.026213 31161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:22.026304 31161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal
uuid: "d9d1787c64734a748fd9eeaeb1a6e22b"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "425c20e0dcba7c0e477fe89471c20bc8"
server_key_iv: "b12165a2cfa255468bd3c4bc09a4b5ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.026357 31161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:22.035501 31161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:22.035749 31161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:22.035843 31161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:22.036010 31161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:22.036273 31161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:22.036302 31161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.036329 31161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:22.036375 31161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.041740 31161 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.130:34597
I20260811 00:54:22.041795 31398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.130:34597 every 8 connection(s)
I20260811 00:54:22.042088 31161 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/data/info.pb
I20260811 00:54:22.042996 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31161
I20260811 00:54:22.043097 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal/instance
I20260811 00:54:22.043284 27022 external_mini_cluster.cc:1428] Setting key 68760acaf69056246d55c2be5be821e2
I20260811 00:54:22.044184 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.99.131:0
--local_ip_for_outbound_sockets=127.26.99.131
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--builtin_ntp_servers=127.26.99.148:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 00:54:22.047133 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.042754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.130:45921 (local address 127.26.99.190:35481)
0811 00:54:22.042809 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.042811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.043004 (+ 193us) server_negotiation.cc:407] Connection header received
0811 00:54:22.043573 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.043575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.043589 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.043634 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:22.044374 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.044871 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.045835 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.046050 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.046106 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.046915 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:22.046916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:22.046917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:22.046921 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:22.046936 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:22.046941 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:22.046983 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.047052 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.047076 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 00:54:22.047356 31402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.042725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35481 (local address 127.26.99.130:45921)
0811 00:54:22.042895 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.042927 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.043474 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.043704 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.043707 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.043715 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:22.044243 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.044250 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.044967 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.044968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.045754 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.045756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.046126 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.046127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.046252 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.046777 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:22.046777 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:22.046813 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:22.046838 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:22.046986 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:22.046990 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:22.046993 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.047054 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.047157 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":72,"threads_started":1}
I20260811 00:54:22.047865 31399 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35481
I20260811 00:54:22.047947 31399 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:22.048125 31399 heartbeater.cc:511] Master 127.26.99.190:35481 requested a full tablet report, sending...
I20260811 00:54:22.048484 30792 ts_manager.cc:194] Registered new tserver with Master: d9d1787c64734a748fd9eeaeb1a6e22b (127.26.99.130:34597)
I20260811 00:54:22.048837 30792 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.130:45921
W20260811 00:54:22.124742 31403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:22.124943 31403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:22.124971 31403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:22.126080 31403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:22.126116 31403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:22.126148 31403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.99.131
I20260811 00:54:22.127460 31403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.99.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.99.131
--webserver_port=0
--tserver_master_addrs=127.26.99.190:35481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.99.131
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:22.127677 31403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:22.127938 31403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:22.132802 31410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:22.132829 31409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:22.132822 31415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:22.132843 31403 server_base.cc:1034] running on GCE node
I20260811 00:54:22.133211 31403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:22.133428 31403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:22.134562 31403 hybrid_clock.cc:648] HybridClock initialized: now 1786409662134557 us; error 39 us; skew 500 ppm
I20260811 00:54:22.135670 31403 webserver.cc:460] Webserver started at http://127.26.99.131:33949/ using document root <none> and password file <none>
I20260811 00:54:22.135870 31403 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:22.135913 31403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:22.136044 31403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:22.137131 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data/instance:
uuid: "829ee8f089bb4d4d887b17e4c7053e8e"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "8d4cb51258ad3f9716fa73fcf65dddee"
server_key_iv: "1e588e0ef491ae475d90697bee6a7fbe"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.137463 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance:
uuid: "829ee8f089bb4d4d887b17e4c7053e8e"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "8d4cb51258ad3f9716fa73fcf65dddee"
server_key_iv: "1e588e0ef491ae475d90697bee6a7fbe"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.138666 31403 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:22.139293 31428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.139436 31403 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:22.139533 31403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal
uuid: "829ee8f089bb4d4d887b17e4c7053e8e"
format_stamp: "Formatted at 2026-08-11 00:54:22 on dist-test-slave-xt4k"
server_key: "8d4cb51258ad3f9716fa73fcf65dddee"
server_key_iv: "1e588e0ef491ae475d90697bee6a7fbe"
server_key_version: "encryptionkey@0"
I20260811 00:54:22.139592 31403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:22.160089 31403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:22.160370 31403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:22.160472 31403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:22.160655 31403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 00:54:22.160920 31403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 00:54:22.160949 31403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.160974 31403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 00:54:22.160998 31403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:22.166214 31403 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.131:38785
I20260811 00:54:22.166271 31642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.131:38785 every 8 connection(s)
I20260811 00:54:22.166566 31403 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/data/info.pb
I20260811 00:54:22.169991 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31403
I20260811 00:54:22.170109 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal/instance
I20260811 00:54:22.170329 27022 external_mini_cluster.cc:1428] Setting key a7669f38728715bd3cd059d6dc77f7c4
I20260811 00:54:22.171682 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.167265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:37743 (local address 127.26.99.190:35481)
0811 00:54:22.167325 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.167326 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.167522 (+ 196us) server_negotiation.cc:407] Connection header received
0811 00:54:22.167972 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.167973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.167982 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.168043 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:22.168732 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.169223 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.170296 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.170530 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.170600 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.171461 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:22.171463 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:22.171463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:22.171468 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:22.171485 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:22.171490 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:22.171536 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.171600 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.171623 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 00:54:22.171852 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.167226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:35481 (local address 127.26.99.131:37743)
0811 00:54:22.167404 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.167443 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.167898 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.168137 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.168141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.168152 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:22.168669 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.168674 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.169286 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.169287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.170221 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.170224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.170615 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.170617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.170764 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.171313 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 00:54:22.171313 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:22.171341 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 00:54:22.171363 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:22.171540 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:22.171545 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:22.171547 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.171596 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.171674 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260811 00:54:22.172253 31644 heartbeater.cc:347] Connected to a master server at 127.26.99.190:35481
I20260811 00:54:22.172358 31644 heartbeater.cc:464] Registering TS with master...
I20260811 00:54:22.172536 31644 heartbeater.cc:511] Master 127.26.99.190:35481 requested a full tablet report, sending...
I20260811 00:54:22.172874 30792 ts_manager.cc:194] Registered new tserver with Master: 829ee8f089bb4d4d887b17e4c7053e8e (127.26.99.131:38785)
I20260811 00:54:22.173285 30792 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.99.131:37743
I20260811 00:54:22.181790 27022 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 00:54:22.185807 30911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.183112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33230 (local address 127.26.99.190:35481)
0811 00:54:22.183186 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.183188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.183253 (+ 65us) server_negotiation.cc:407] Connection header received
0811 00:54:22.183316 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.183317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.183328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.183368 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:22.183518 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.183966 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.184774 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.184954 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.185007 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.185593 (+ 586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:22.185594 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:22.185594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:22.185599 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:22.185613 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:22.185617 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:22.185660 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.185713 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.185736 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 00:54:22.187132 30792 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 00:54:22.188619 30792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 00:54:22.194581 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35748 (local address 127.26.99.131:38785)
0811 00:54:22.190908 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.190913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.191389 (+ 476us) server_negotiation.cc:407] Connection header received
0811 00:54:22.191429 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.191431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.191445 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.191495 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.191682 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192657 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.193694 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.194182 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.194247 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.194337 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.194448 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.194509 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 00:54:22.194602 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38785 (local address 127.0.0.1:35748)
0811 00:54:22.191183 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.191193 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.191242 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.191574 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.191574 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.191576 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.191609 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.191611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192726 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.192727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.193619 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.193622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.194261 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.194262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.194346 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.194360 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.194431 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.194517 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":34,"thread_start_us":62,"threads_started":1}
I20260811 00:54:22.194687 31667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60626 (local address 127.26.99.130:34597)
0811 00:54:22.190949 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.190953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.190962 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:22.191006 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.191007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.191020 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.191089 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.191276 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192124 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.193613 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.194226 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.194296 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.194388 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.194566 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.194610 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":93,"threads_started":1}
I20260811 00:54:22.195066 31659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34597 (local address 127.0.0.1:60626)
0811 00:54:22.190600 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.190638 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.190698 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.191107 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.191130 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.191133 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.191195 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.191197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192194 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.192195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.193481 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.193485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.194303 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.194304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.194375 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.194379 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.194431 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.194503 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":20,"thread_start_us":62,"threads_started":1}
I20260811 00:54:22.195307 31504 tablet_service.cc:1467] Processing CreateTablet for tablet 47073fd010f644cfa508b244d013fb1d (DEFAULT_TABLE table=test-table [id=6193f071b1584fd696f1c61f8a5fddd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:22.195703 31504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47073fd010f644cfa508b244d013fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:22.195749 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35893 (local address 127.0.0.1:57012)
0811 00:54:22.190926 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.190935 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.190990 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.191226 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.191227 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.191229 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.191275 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.191276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192461 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.192462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.193518 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.193520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.195564 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.195565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.195628 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.195632 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.195669 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.195705 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":84,"threads_started":1}
I20260811 00:54:22.195727 31274 tablet_service.cc:1467] Processing CreateTablet for tablet 47073fd010f644cfa508b244d013fb1d (DEFAULT_TABLE table=test-table [id=6193f071b1584fd696f1c61f8a5fddd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:22.196048 31274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47073fd010f644cfa508b244d013fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:22.196110 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.190760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.26.99.129:35893)
0811 00:54:22.190912 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.190916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.190979 (+ 63us) server_negotiation.cc:407] Connection header received
0811 00:54:22.191069 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.191071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.191086 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.191152 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.191332 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.192385 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.194427 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.195428 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.195880 (+ 452us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.195981 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.196007 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.196044 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260811 00:54:22.196820 31026 tablet_service.cc:1467] Processing CreateTablet for tablet 47073fd010f644cfa508b244d013fb1d (DEFAULT_TABLE table=test-table [id=6193f071b1584fd696f1c61f8a5fddd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 00:54:22.197111 31026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47073fd010f644cfa508b244d013fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:22.199138 31677 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Bootstrap starting.
I20260811 00:54:22.199747 31678 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: Bootstrap starting.
I20260811 00:54:22.199815 31677 tablet_bootstrap.cc:654] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:22.200080 31677 log.cc:824] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:22.200300 31678 tablet_bootstrap.cc:654] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:22.200399 31675 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Bootstrap starting.
I20260811 00:54:22.200675 31678 log.cc:824] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:22.200870 31677 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: No bootstrap required, opened a new log
I20260811 00:54:22.200941 31677 ts_tablet_manager.cc:1397] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:22.200953 31675 tablet_bootstrap.cc:654] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:22.201257 31675 log.cc:824] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:22.201572 31678 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: No bootstrap required, opened a new log
I20260811 00:54:22.201647 31678 ts_tablet_manager.cc:1397] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 00:54:22.202010 31675 tablet_bootstrap.cc:492] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: No bootstrap required, opened a new log
I20260811 00:54:22.202072 31675 ts_tablet_manager.cc:1397] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 00:54:22.203352 31677 raft_consensus.cc:348] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.203521 31677 raft_consensus.cc:374] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:22.203558 31677 raft_consensus.cc:729] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829ee8f089bb4d4d887b17e4c7053e8e, State: Initialized, Role: FOLLOWER
I20260811 00:54:22.203699 31677 consensus_queue.cc:260] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.203961 31677 ts_tablet_manager.cc:1428] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 00:54:22.203882 31675 raft_consensus.cc:348] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.204002 31644 heartbeater.cc:503] Master 127.26.99.190:35481 was elected leader, sending a full tablet report...
I20260811 00:54:22.204032 31675 raft_consensus.cc:374] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:22.204064 31675 raft_consensus.cc:729] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9d1787c64734a748fd9eeaeb1a6e22b, State: Initialized, Role: FOLLOWER
I20260811 00:54:22.204061 31678 raft_consensus.cc:348] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.204180 31678 raft_consensus.cc:374] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:22.204171 31675 consensus_queue.cc:260] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.204210 31678 raft_consensus.cc:729] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f36de87700b54d52bd154c2eb10dd529, State: Initialized, Role: FOLLOWER
I20260811 00:54:22.204365 31678 consensus_queue.cc:260] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.204437 31675 ts_tablet_manager.cc:1428] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 00:54:22.204566 31399 heartbeater.cc:503] Master 127.26.99.190:35481 was elected leader, sending a full tablet report...
I20260811 00:54:22.204627 31678 ts_tablet_manager.cc:1428] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 00:54:22.204757 31158 heartbeater.cc:503] Master 127.26.99.190:35481 was elected leader, sending a full tablet report...
I20260811 00:54:22.282703 31686 raft_consensus.cc:482] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:22.282850 31686 raft_consensus.cc:504] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.283242 31686 leader_election.cc:288] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9d1787c64734a748fd9eeaeb1a6e22b (127.26.99.130:34597), 829ee8f089bb4d4d887b17e4c7053e8e (127.26.99.131:38785)
I20260811 00:54:22.285130 31683 raft_consensus.cc:482] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 00:54:22.285233 31683 raft_consensus.cc:504] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.285943 31683 leader_election.cc:288] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9d1787c64734a748fd9eeaeb1a6e22b (127.26.99.130:34597), f36de87700b54d52bd154c2eb10dd529 (127.26.99.129:35893)
I20260811 00:54:22.286974 31160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.283397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34597 (local address 127.26.99.129:49503)
0811 00:54:22.283451 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.283464 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.283514 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.283676 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.283677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.283680 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.283759 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.283762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.284736 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.284738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.285979 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.285982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.286722 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.286798 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.286802 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.286846 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.286895 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 00:54:22.287042 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.283658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:47357 (local address 127.26.99.131:38785)
0811 00:54:22.283711 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.283713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.283808 (+ 95us) server_negotiation.cc:407] Connection header received
0811 00:54:22.283846 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.283847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.283856 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.283912 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.284066 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.284789 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286093 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.286573 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286620 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.286629 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.286927 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.286968 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 00:54:22.287267 31688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.283524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.131:38785 (local address 127.26.99.129:47357)
0811 00:54:22.283669 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.283679 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.283741 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.283941 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.283942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.283944 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.284006 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.284007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.284861 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.284861 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.285980 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.285991 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.286768 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.286855 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.286858 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.287144 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.287188 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":1,"thread_start_us":83,"threads_started":1}
I20260811 00:54:22.287268 31667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.283473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.129:49503 (local address 127.26.99.130:34597)
0811 00:54:22.283527 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.283529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.283537 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:22.283568 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.283569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.283578 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.283637 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.283853 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.284638 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286071 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.286600 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.286662 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.286671 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.287153 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.287204 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:54:22.287528 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "f36de87700b54d52bd154c2eb10dd529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" is_pre_election: true
I20260811 00:54:22.287663 31311 raft_consensus.cc:2454] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f36de87700b54d52bd154c2eb10dd529 in term 0.
I20260811 00:54:22.288021 30943 leader_election.cc:302] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9d1787c64734a748fd9eeaeb1a6e22b, f36de87700b54d52bd154c2eb10dd529; no voters:
I20260811 00:54:22.288157 31686 raft_consensus.cc:2781] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 00:54:22.288219 31686 raft_consensus.cc:482] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 00:54:22.288242 31686 raft_consensus.cc:3037] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:22.288316 31538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "f36de87700b54d52bd154c2eb10dd529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" is_pre_election: true
I20260811 00:54:22.288444 31538 raft_consensus.cc:2454] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f36de87700b54d52bd154c2eb10dd529 in term 0.
I20260811 00:54:22.289167 31686 raft_consensus.cc:504] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.289273 31694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.285676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.130:34597 (local address 127.26.99.131:48075)
0811 00:54:22.285938 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.285948 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.285992 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.286268 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.286269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.286271 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.286341 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.286342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.287170 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.287170 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.288273 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.288275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.288999 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.289000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.289082 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.289087 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.289146 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.289188 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":144,"thread_start_us":74,"threads_started":1}
I20260811 00:54:22.289269 31691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.285747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:48075 (local address 127.26.99.130:34597)
0811 00:54:22.286152 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.286154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.286160 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:54:22.286182 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.286182 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.286191 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.286256 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.286403 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.287088 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.288389 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.288911 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.288984 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.288991 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.289156 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.289193 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":90,"threads_started":1}
I20260811 00:54:22.289471 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" is_pre_election: true
I20260811 00:54:22.289546 31311 raft_consensus.cc:2454] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 829ee8f089bb4d4d887b17e4c7053e8e in term 0.
I20260811 00:54:22.289526 31310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "f36de87700b54d52bd154c2eb10dd529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b"
I20260811 00:54:22.289601 31310 raft_consensus.cc:3037] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:22.289708 31439 leader_election.cc:302] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829ee8f089bb4d4d887b17e4c7053e8e, d9d1787c64734a748fd9eeaeb1a6e22b; no voters:
I20260811 00:54:22.289753 31538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "f36de87700b54d52bd154c2eb10dd529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829ee8f089bb4d4d887b17e4c7053e8e"
I20260811 00:54:22.289812 31538 raft_consensus.cc:3037] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:22.290452 31310 raft_consensus.cc:2454] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f36de87700b54d52bd154c2eb10dd529 in term 1.
I20260811 00:54:22.290529 31538 raft_consensus.cc:2454] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f36de87700b54d52bd154c2eb10dd529 in term 1.
I20260811 00:54:22.290691 30943 leader_election.cc:302] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 829ee8f089bb4d4d887b17e4c7053e8e, f36de87700b54d52bd154c2eb10dd529; no voters:
I20260811 00:54:22.290714 31683 raft_consensus.cc:2741] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260811 00:54:22.290869 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.285675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35893 (local address 127.26.99.131:50963)
0811 00:54:22.285732 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.285742 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:22.285778 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:22.287769 (+ 1991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:22.287770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:22.287771 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 00:54:22.287830 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.287832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.288903 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.288904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.289811 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:22.289814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.290639 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.290640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:22.290711 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.290714 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 00:54:22.290767 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 00:54:22.290809 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 00:54:22.290697 31686 leader_election.cc:288] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [CANDIDATE]: Term 1 election: Requested vote from peers d9d1787c64734a748fd9eeaeb1a6e22b (127.26.99.130:34597), 829ee8f089bb4d4d887b17e4c7053e8e (127.26.99.131:38785)
I20260811 00:54:22.290968 31686 raft_consensus.cc:2781] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:22.291003 31686 raft_consensus.cc:686] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 1 LEADER]: Becoming Leader. State: Replica: f36de87700b54d52bd154c2eb10dd529, State: Running, Role: LEADER
I20260811 00:54:22.291078 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.286701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.99.131:50963 (local address 127.26.99.129:35893)
0811 00:54:22.287502 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.287504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.287512 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:22.287533 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.287534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.287653 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.287708 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 00:54:22.288201 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.288813 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.290045 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.290534 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.290600 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.290607 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.290836 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.290877 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":781}
I20260811 00:54:22.291086 31686 consensus_queue.cc:237] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } }
I20260811 00:54:22.291273 31068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47073fd010f644cfa508b244d013fb1d" candidate_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f36de87700b54d52bd154c2eb10dd529" is_pre_election: true
I20260811 00:54:22.291994 30791 catalog_manager.cc:5495] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 reported cstate change: term changed from 0 to 1, leader changed from <none> to f36de87700b54d52bd154c2eb10dd529 (127.26.99.129). New cstate: current_term: 1 leader_uuid: "f36de87700b54d52bd154c2eb10dd529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f36de87700b54d52bd154c2eb10dd529" member_type: VOTER last_known_addr { host: "127.26.99.129" port: 35893 } health_report { overall_health: HEALTHY } } }
W20260811 00:54:22.292586 31400 tablet.cc:2369] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 00:54:22.308529 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.306289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57028 (local address 127.26.99.129:35893)
0811 00:54:22.306345 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:22.306347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:22.306370 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:54:22.306406 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:22.306407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:22.306424 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:22.306478 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:22.306599 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.307065 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.307789 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:22.307978 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:22.308034 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:22.308174 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:22.308284 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:22.308376 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:22.308395 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 00:54:22.308419 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 00:54:22.310307 31538 raft_consensus.cc:1261] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 1 FOLLOWER]: Refusing update from remote peer f36de87700b54d52bd154c2eb10dd529: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:22.310316 31310 raft_consensus.cc:1261] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 1 FOLLOWER]: Refusing update from remote peer f36de87700b54d52bd154c2eb10dd529: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:22.310658 31686 consensus_queue.cc:1035] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9d1787c64734a748fd9eeaeb1a6e22b" member_type: VOTER last_known_addr { host: "127.26.99.130" port: 34597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:22.310842 31696 consensus_queue.cc:1035] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829ee8f089bb4d4d887b17e4c7053e8e" member_type: VOTER last_known_addr { host: "127.26.99.131" port: 38785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:22.313592 31709 mvcc.cc:205] Tried to move back new op lower bound from 7317133976820289536 to 7317133976745005056. Current Snapshot: MvccSnapshot[applied={T|T < 7317133976820289536 or (T in {7317133976820289536})}]
I20260811 00:54:22.313849 31711 mvcc.cc:205] Tried to move back new op lower bound from 7317133976820289536 to 7317133976745005056. Current Snapshot: MvccSnapshot[applied={T|T < 7317133976820289536}]
I20260811 00:54:22.315019 30792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:22.315100 30792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 00:54:22.315773 30792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cb748daffca4a28ab5f36573ea0625a: Sending DeleteTablet for 3 replicas of tablet 47073fd010f644cfa508b244d013fb1d
I20260811 00:54:22.316109 31504 tablet_service.cc:1514] Processing DeleteTablet for tablet 47073fd010f644cfa508b244d013fb1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:22 UTC) from {username='slave'} at 127.0.0.1:35748
I20260811 00:54:22.316113 31026 tablet_service.cc:1514] Processing DeleteTablet for tablet 47073fd010f644cfa508b244d013fb1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:22 UTC) from {username='slave'} at 127.0.0.1:57012
I20260811 00:54:22.316356 31730 tablet_replica.cc:330] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529: stopping tablet replica
I20260811 00:54:22.316373 31274 tablet_service.cc:1514] Processing DeleteTablet for tablet 47073fd010f644cfa508b244d013fb1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 00:54:22 UTC) from {username='slave'} at 127.0.0.1:60626
I20260811 00:54:22.316447 31730 raft_consensus.cc:2229] T 47073fd010f644cfa508b244d013fb1d P f36de87700b54d52bd154c2eb10dd529 [term 1 LEADER]: Raft consensus shutting down.
I20260811 00:54:22.316461 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30913
I20260811 00:54:22.330750 31733 tablet_replica.cc:330] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: stopping tablet replica
I20260811 00:54:22.330864 31733 raft_consensus.cc:2229] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:22.330958 31733 raft_consensus.cc:2258] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:22.332773 31733 ts_tablet_manager.cc:1905] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:22.334884 31733 ts_tablet_manager.cc:1918] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:22.334993 31733 log.cc:1196] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-1/wal/wals/47073fd010f644cfa508b244d013fb1d
I20260811 00:54:22.335144 31732 tablet_replica.cc:330] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: stopping tablet replica
I20260811 00:54:22.335273 31732 raft_consensus.cc:2229] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 00:54:22.335268 31733 ts_tablet_manager.cc:1939] T 47073fd010f644cfa508b244d013fb1d P d9d1787c64734a748fd9eeaeb1a6e22b: Deleting consensus metadata
I20260811 00:54:22.335403 31732 raft_consensus.cc:2258] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 00:54:22.335768 30763 catalog_manager.cc:4841] TS d9d1787c64734a748fd9eeaeb1a6e22b (127.26.99.130:34597): tablet 47073fd010f644cfa508b244d013fb1d (table test-table [id=6193f071b1584fd696f1c61f8a5fddd5]) successfully deleted
I20260811 00:54:22.335844 31732 ts_tablet_manager.cc:1905] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 00:54:22.337065 31732 ts_tablet_manager.cc:1918] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 00:54:22.337139 31732 log.cc:1196] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Deleting WAL directory at /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786409417711920-27022-0/minicluster-data/ts-2/wal/wals/47073fd010f644cfa508b244d013fb1d
I20260811 00:54:22.337352 31732 ts_tablet_manager.cc:1939] T 47073fd010f644cfa508b244d013fb1d P 829ee8f089bb4d4d887b17e4c7053e8e: Deleting consensus metadata
I20260811 00:54:22.337766 30763 catalog_manager.cc:4841] TS 829ee8f089bb4d4d887b17e4c7053e8e (127.26.99.131:38785): tablet 47073fd010f644cfa508b244d013fb1d (table test-table [id=6193f071b1584fd696f1c61f8a5fddd5]) successfully deleted
W20260811 00:54:22.339978 30762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.99.129:35893 (error 108)
I20260811 00:54:22.340055 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31161
I20260811 00:54:22.342542 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:22.342403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.129:35893 (local address 127.0.0.1:57034)
0811 00:54:22.342453 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:22.342498 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.129:35893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 00:54:22.342674 30762 catalog_manager.cc:4584] TS f36de87700b54d52bd154c2eb10dd529 (127.26.99.129:35893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 47073fd010f644cfa508b244d013fb1d: Network error: Client connection negotiation failed: client connection to 127.26.99.129:35893: connect: Connection refused (error 111)
I20260811 00:54:22.350564 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31403
I20260811 00:54:22.377563 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 30737
2026-08-11T00:54:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (774 ms)
[----------] 6 tests from EncryptionPolicyTest (8772 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:22 dist-test-slave-xt4k krb5kdc[31746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:22 dist-test-slave-xt4k krb5kdc[31746](info): set up 2 sockets
Aug 11 00:54:22 dist-test-slave-xt4k krb5kdc[31746](info): commencing operation
krb5kdc: starting...
W20260811 00:54:23.573964 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:23.691841 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35097
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:23.775913 31778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:23.776117 31778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:23.776139 31778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:23.777242 31778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:23.777277 31778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:23.777290 31778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:23.777302 31778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:23.777311 31778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:23.778720 31778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35097
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:23.778910 31778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:23.779080 31778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:23.783715 31790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:23.783722 31788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:23.783735 31787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:23.783864 31778 server_base.cc:1034] running on GCE node
I20260811 00:54:23.784180 31778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:23.784478 31778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:23.785636 31778 hybrid_clock.cc:648] HybridClock initialized: now 1786409663785623 us; error 27 us; skew 500 ppm
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409663, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:23.791244 31778 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:23.791709 31778 webserver.cc:460] Webserver started at http://127.0.0.1:42739/ using document root <none> and password file <none>
I20260811 00:54:23.791913 31778 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:23.791960 31778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:23.792091 31778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:23.793193 31778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "6bb45e1e37ef457b9022368a6075718a"
format_stamp: "Formatted at 2026-08-11 00:54:23 on dist-test-slave-xt4k"
server_key: "ce64090f2b304224ff585e1fec0a2513"
server_key_iv: "042c3cca171e93cfef42588dd7810846"
server_key_version: "encryptionkey@0"
I20260811 00:54:23.793530 31778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "6bb45e1e37ef457b9022368a6075718a"
format_stamp: "Formatted at 2026-08-11 00:54:23 on dist-test-slave-xt4k"
server_key: "ce64090f2b304224ff585e1fec0a2513"
server_key_iv: "042c3cca171e93cfef42588dd7810846"
server_key_version: "encryptionkey@0"
I20260811 00:54:23.794806 31778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:54:23.795465 31803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:23.795619 31778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:23.795706 31778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "6bb45e1e37ef457b9022368a6075718a"
format_stamp: "Formatted at 2026-08-11 00:54:23 on dist-test-slave-xt4k"
server_key: "ce64090f2b304224ff585e1fec0a2513"
server_key_iv: "042c3cca171e93cfef42588dd7810846"
server_key_version: "encryptionkey@0"
I20260811 00:54:23.795768 31778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:23.811062 31778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:23.812798 31778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:23.812930 31778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:23.816725 31778 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35097
I20260811 00:54:23.816758 31901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35097 every 8 connection(s)
I20260811 00:54:23.817060 31778 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:23.817284 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31778
I20260811 00:54:23.817389 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:23.817602 27022 external_mini_cluster.cc:1428] Setting key e44e2325011a680ed5727435c6200f39
I20260811 00:54:23.818071 31902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:23.821228 31902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a: Bootstrap starting.
I20260811 00:54:23.821835 31902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:23.822144 31902 log.cc:824] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:23.822876 31902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a: No bootstrap required, opened a new log
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:54:23.824734 31902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } }
I20260811 00:54:23.824898 31902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:23.824955 31902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bb45e1e37ef457b9022368a6075718a, State: Initialized, Role: FOLLOWER
I20260811 00:54:23.825089 31902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } }
I20260811 00:54:23.825182 31902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:23.825215 31902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:23.825264 31902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:23.825939 31902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } }
I20260811 00:54:23.826049 31902 leader_election.cc:302] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bb45e1e37ef457b9022368a6075718a; no voters:
I20260811 00:54:23.826210 31902 leader_election.cc:288] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:23.826262 31910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:23.826401 31910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [term 1 LEADER]: Becoming Leader. State: Replica: 6bb45e1e37ef457b9022368a6075718a, State: Running, Role: LEADER
I20260811 00:54:23.826485 31902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:23.826510 31910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } }
I20260811 00:54:23.826841 31910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bb45e1e37ef457b9022368a6075718a. Latest consensus state: current_term: 1 leader_uuid: "6bb45e1e37ef457b9022368a6075718a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } } }
I20260811 00:54:23.826898 31910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:23.827037 31914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bb45e1e37ef457b9022368a6075718a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bb45e1e37ef457b9022368a6075718a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35097 } } }
I20260811 00:54:23.827131 31914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:23.827919 31920 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:23.828464 31920 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:23.828613 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:23.818133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44141 (local address 127.0.0.1:35097)
0811 00:54:23.818330 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:23.818339 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:23.818371 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:54:23.818832 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:23.818841 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:23.818901 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:23.819047 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:23.819589 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:23.820946 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:23.821686 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:23.822289 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:23.822407 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:23.824573 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:23.824577 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:23.824578 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:23.824589 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:23.826444 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:23.826928 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:23.826931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:23.826931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:23.827046 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:23.827338 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:23.827339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:23.827339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:23.827661 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:23.828248 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:23.828330 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 00:54:23.828445 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
I20260811 00:54:23.829511 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:23.832721 31920 catalog_manager.cc:1347] Generated new cluster ID: a92542d7e9a0491cb6b6c97bc3f0f235
I20260811 00:54:23.832777 31920 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:23.840394 31907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:23.830808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42649 (local address 127.0.0.1:35097)
0811 00:54:23.830841 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:23.830843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:23.830918 (+ 75us) server_negotiation.cc:407] Connection header received
0811 00:54:23.830999 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:23.831000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:23.831006 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:23.831048 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:23.831638 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:23.832097 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:23.836779 (+ 4682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:23.836994 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:23.837050 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:23.838124 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:23.838125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:23.838126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:23.838133 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:23.839339 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:23.839682 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:23.839683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:23.839684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:23.839733 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:23.839919 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:23.839920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:23.839920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:23.840019 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:23.840107 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:23.840230 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:54:23.840288 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:23.878574 31920 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:23.879354 31920 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:23.886188 31920 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bb45e1e37ef457b9022368a6075718a: Generated new TSK 0
I20260811 00:54:23.886384 31920 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:23.897895 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31778
W20260811 00:54:23.906284 31742 connection.cc:535] client connection to 127.0.0.1:35097 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35097): Connection reset by peer (error 104)
2026-08-11T00:54:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1513 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31960](info): set up 2 sockets
Aug 11 00:54:23 dist-test-slave-xt4k krb5kdc[31960](info): commencing operation
krb5kdc: starting...
W20260811 00:54:25.093154 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:25 dist-test-slave-xt4k krb5kdc[31960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:25.212422 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:25.298502 31986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:25.298717 31986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:25.298751 31986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:25.299933 31986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:25.299973 31986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:25.299994 31986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:25.300009 31986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:25.300026 31986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:25.301579 31986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40329
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:25.301815 31986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:25.302033 31986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:25.306839 31997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:25.306951 31993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:25.306984 31986 server_base.cc:1034] running on GCE node
W20260811 00:54:25.306840 31994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:25.307231 31986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:25.307528 31986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:25.308671 31986 hybrid_clock.cc:648] HybridClock initialized: now 1786409665308652 us; error 34 us; skew 500 ppm
Aug 11 00:54:25 dist-test-slave-xt4k krb5kdc[31960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409665, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:25.311102 31986 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:25.311527 31986 webserver.cc:460] Webserver started at http://127.0.0.1:40553/ using document root <none> and password file <none>
I20260811 00:54:25.311729 31986 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:25.311771 31986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:25.311859 31986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:25.312911 31986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "185a58055dba4c498f15d8ef909e3149"
format_stamp: "Formatted at 2026-08-11 00:54:25 on dist-test-slave-xt4k"
server_key: "8bb80c9c7d3a0035c4aa363556e2a279"
server_key_iv: "31ee1fbb898f48b585b59a917fc109c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:25.313222 31986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "185a58055dba4c498f15d8ef909e3149"
format_stamp: "Formatted at 2026-08-11 00:54:25 on dist-test-slave-xt4k"
server_key: "8bb80c9c7d3a0035c4aa363556e2a279"
server_key_iv: "31ee1fbb898f48b585b59a917fc109c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:25.314545 31986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:25.315306 32011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:25.315501 31986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:25.315591 31986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "185a58055dba4c498f15d8ef909e3149"
format_stamp: "Formatted at 2026-08-11 00:54:25 on dist-test-slave-xt4k"
server_key: "8bb80c9c7d3a0035c4aa363556e2a279"
server_key_iv: "31ee1fbb898f48b585b59a917fc109c7"
server_key_version: "encryptionkey@0"
I20260811 00:54:25.315652 31986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:25.326104 31986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:25.328531 31986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:25.328660 31986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:25.332576 31986 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40329
I20260811 00:54:25.332618 32105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40329 every 8 connection(s)
I20260811 00:54:25.332975 31986 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:25.334009 32106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:25.336387 32106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149: Bootstrap starting.
I20260811 00:54:25.336941 32106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:25.337210 32106 log.cc:824] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:25.337430 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 31986
I20260811 00:54:25.337534 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:25.337786 27022 external_mini_cluster.cc:1428] Setting key a19226b657102a1fee801c1f7cc88853
I20260811 00:54:25.337921 32106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149: No bootstrap required, opened a new log
I20260811 00:54:25.340696 32106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } }
I20260811 00:54:25.340866 32106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:25.340896 32106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185a58055dba4c498f15d8ef909e3149, State: Initialized, Role: FOLLOWER
I20260811 00:54:25.341019 32106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } }
I20260811 00:54:25.341099 32106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:25.341177 32106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:25.341228 32106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:25.341780 32106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } }
I20260811 00:54:25.341882 32106 leader_election.cc:302] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 185a58055dba4c498f15d8ef909e3149; no voters:
I20260811 00:54:25.342041 32106 leader_election.cc:288] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:25.342098 32112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:25.342288 32112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [term 1 LEADER]: Becoming Leader. State: Replica: 185a58055dba4c498f15d8ef909e3149, State: Running, Role: LEADER
I20260811 00:54:25.342286 32106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:25.342449 32112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } }
I20260811 00:54:25.342820 32117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 185a58055dba4c498f15d8ef909e3149. Latest consensus state: current_term: 1 leader_uuid: "185a58055dba4c498f15d8ef909e3149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } } }
I20260811 00:54:25.342846 32115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "185a58055dba4c498f15d8ef909e3149" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185a58055dba4c498f15d8ef909e3149" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40329 } } }
I20260811 00:54:25.342959 32117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:25.342971 32115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:25.343220 32121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:25.343943 32121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:25.344142 32111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:25.338366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51241 (local address 127.0.0.1:40329)
0811 00:54:25.338569 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:25.338579 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:25.338615 (+ 36us) server_negotiation.cc:407] Connection header received
0811 00:54:25.339210 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:25.339220 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:25.339285 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:25.339433 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:25.339649 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:25.341039 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:25.341867 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:25.342515 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:25.342662 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:25.343364 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:25.343368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:25.343369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:25.343554 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:25.343587 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:25.343598 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:25.343680 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:25.343864 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 00:54:25.343891 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
I20260811 00:54:25.345382 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:25.345896 32121 catalog_manager.cc:1347] Generated new cluster ID: 1e3f61fb17d643f49516f20c879cea6c
I20260811 00:54:25.345939 32121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:25.350212 32111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:25.346838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39883 (local address 127.0.0.1:40329)
0811 00:54:25.346885 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:25.346886 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:25.347041 (+ 155us) server_negotiation.cc:407] Connection header received
0811 00:54:25.347076 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:25.347077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:25.347087 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:25.347151 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:25.347268 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:25.347966 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:25.348960 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:25.349280 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:25.349352 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:25.349984 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:25.349986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:25.349986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:25.349990 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:25.350008 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:25.350013 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:25.350076 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:25.350133 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 00:54:25.350144 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:25.352072 32121 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:25.352633 32121 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:25.354737 32121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 185a58055dba4c498f15d8ef909e3149: Generated new TSK 0
I20260811 00:54:25.354883 32121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:25.363758 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 31986
W20260811 00:54:25.374694 31951 connection.cc:535] client connection to 127.0.0.1:40329 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40329): Connection reset by peer (error 104)
2026-08-11T00:54:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:25 dist-test-slave-xt4k krb5kdc[32159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:25 dist-test-slave-xt4k krb5kdc[32159](info): set up 2 sockets
Aug 11 00:54:25 dist-test-slave-xt4k krb5kdc[32159](info): commencing operation
krb5kdc: starting...
W20260811 00:54:26.542078 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:26 dist-test-slave-xt4k krb5kdc[32159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:26.654896 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46739
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:26.735140 32177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:26.735334 32177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:26.735355 32177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:26.736512 32177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:26.736550 32177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:26.736563 32177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:26.736575 32177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:26.736598 32177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:26.738061 32177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46739
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:26.738283 32177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:26.738485 32177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:26.743008 32190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:26.743057 32187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:26.743009 32186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:26.743024 32177 server_base.cc:1034] running on GCE node
I20260811 00:54:26.743384 32177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:26.743652 32177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:26.744784 32177 hybrid_clock.cc:648] HybridClock initialized: now 1786409666744772 us; error 28 us; skew 500 ppm
Aug 11 00:54:26 dist-test-slave-xt4k krb5kdc[32159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409666, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:26.747393 32177 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:26.747910 32177 webserver.cc:460] Webserver started at http://127.0.0.1:32855/ using document root <none> and password file <none>
I20260811 00:54:26.748174 32177 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:26.748236 32177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:26.748438 32177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:26.749670 32177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "350721d9ce834f4e84e3b29386a5e5bb"
format_stamp: "Formatted at 2026-08-11 00:54:26 on dist-test-slave-xt4k"
server_key: "3e3449b37115bb0f1be0b42aef1ba836"
server_key_iv: "15a2d1e8a0bfb01c4975b7c7f170957a"
server_key_version: "encryptionkey@0"
I20260811 00:54:26.750065 32177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "350721d9ce834f4e84e3b29386a5e5bb"
format_stamp: "Formatted at 2026-08-11 00:54:26 on dist-test-slave-xt4k"
server_key: "3e3449b37115bb0f1be0b42aef1ba836"
server_key_iv: "15a2d1e8a0bfb01c4975b7c7f170957a"
server_key_version: "encryptionkey@0"
I20260811 00:54:26.751348 32177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:26.752022 32199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:26.752178 32177 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:26.752262 32177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "350721d9ce834f4e84e3b29386a5e5bb"
format_stamp: "Formatted at 2026-08-11 00:54:26 on dist-test-slave-xt4k"
server_key: "3e3449b37115bb0f1be0b42aef1ba836"
server_key_iv: "15a2d1e8a0bfb01c4975b7c7f170957a"
server_key_version: "encryptionkey@0"
I20260811 00:54:26.752328 32177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:26.755473 32177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:26.757462 32177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:26.757587 32177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:26.761250 32177 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46739
I20260811 00:54:26.761307 32306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46739 every 8 connection(s)
I20260811 00:54:26.761600 32177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:26.762537 32308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:26.764722 32308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb: Bootstrap starting.
I20260811 00:54:26.765239 32308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:26.765489 32308 log.cc:824] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:26.766106 32308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb: No bootstrap required, opened a new log
I20260811 00:54:26.767616 32308 raft_consensus.cc:348] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 00:54:26.767741 32308 raft_consensus.cc:374] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:26.767773 32308 raft_consensus.cc:729] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 350721d9ce834f4e84e3b29386a5e5bb, State: Initialized, Role: FOLLOWER
I20260811 00:54:26.767906 32308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 00:54:26.767983 32308 raft_consensus.cc:388] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:26.768014 32308 raft_consensus.cc:482] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:26.768060 32308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:26.768599 32308 raft_consensus.cc:504] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 00:54:26.768692 32308 leader_election.cc:302] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 350721d9ce834f4e84e3b29386a5e5bb; no voters:
I20260811 00:54:26.768836 32308 leader_election.cc:288] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:26.768872 32314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:26.769016 32314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [term 1 LEADER]: Becoming Leader. State: Replica: 350721d9ce834f4e84e3b29386a5e5bb, State: Running, Role: LEADER
I20260811 00:54:26.769063 32308 sys_catalog.cc:564] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:26.769094 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32177
I20260811 00:54:26.769095 32314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } }
I20260811 00:54:26.769196 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:26.769373 27022 external_mini_cluster.cc:1428] Setting key 141e63995b3f912531ca9e00c531821c
I20260811 00:54:26.769559 32315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "350721d9ce834f4e84e3b29386a5e5bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } } }
I20260811 00:54:26.769630 32315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:26.769924 32317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 350721d9ce834f4e84e3b29386a5e5bb. Latest consensus state: current_term: 1 leader_uuid: "350721d9ce834f4e84e3b29386a5e5bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350721d9ce834f4e84e3b29386a5e5bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46739 } } }
I20260811 00:54:26.770081 32328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:26.770634 32328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:26.770083 32317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:26.771835 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:26.769889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45561 (local address 127.0.0.1:46739)
0811 00:54:26.770313 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:26.770322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:26.770353 (+ 31us) server_negotiation.cc:407] Connection header received
0811 00:54:26.770469 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:26.770477 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:26.770506 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:26.770648 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:26.771418 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:26.771421 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:26.771422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:26.771426 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:26.771469 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:26.771483 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:26.771551 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:26.771621 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 00:54:26.771660 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":99,"threads_started":1}
I20260811 00:54:26.772586 32328 catalog_manager.cc:1347] Generated new cluster ID: 22089046fd3d4d8db0d0383b0ceb3c70
I20260811 00:54:26.772682 32328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:26.772804 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:26.777385 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:26.774078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57525 (local address 127.0.0.1:46739)
0811 00:54:26.774110 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:26.774112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:26.776580 (+ 2468us) server_negotiation.cc:407] Connection header received
0811 00:54:26.776626 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:26.776627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:26.776633 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:26.776681 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:26.777189 (+ 508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:26.777191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:26.777191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:26.777195 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:26.777209 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:26.777213 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:26.777266 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:26.777312 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 00:54:26.777324 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:54:26.780169 32328 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:26.780377 32328 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:26.784034 32328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 350721d9ce834f4e84e3b29386a5e5bb: Generated new TSK 0
I20260811 00:54:26.784204 32328 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:26.785823 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32177
2026-08-11T00:54:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:26 dist-test-slave-xt4k krb5kdc[32365](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:26 dist-test-slave-xt4k krb5kdc[32365](info): set up 2 sockets
Aug 11 00:54:26 dist-test-slave-xt4k krb5kdc[32365](info): commencing operation
krb5kdc: starting...
W20260811 00:54:27.989845 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:28.103130 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37613
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:28.183350 32390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:28.183607 32390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:28.183634 32390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:28.184799 32390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:28.184832 32390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:28.184845 32390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:28.184856 32390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:28.184866 32390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:28.186307 32390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:28.186501 32390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:28.186689 32390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:28.191709 32401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:28.191830 32407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:28.191709 32402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:28.192755 32390 server_base.cc:1034] running on GCE node
I20260811 00:54:28.192974 32390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:28.193231 32390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:28.194396 32390 hybrid_clock.cc:648] HybridClock initialized: now 1786409668194376 us; error 30 us; skew 500 ppm
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32365](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409668, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:28.196913 32390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:28.197371 32390 webserver.cc:460] Webserver started at http://127.0.0.1:42895/ using document root <none> and password file <none>
I20260811 00:54:28.197567 32390 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:28.197624 32390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:28.197748 32390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:28.198809 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "3d41d29bf7ae454590f7794e663a9101"
format_stamp: "Formatted at 2026-08-11 00:54:28 on dist-test-slave-xt4k"
server_key: "b20dcf3d3677ddacbf792454bc58c1b1"
server_key_iv: "eafc66be057a6e4dad30732fad0c3698"
server_key_version: "encryptionkey@0"
I20260811 00:54:28.199143 32390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "3d41d29bf7ae454590f7794e663a9101"
format_stamp: "Formatted at 2026-08-11 00:54:28 on dist-test-slave-xt4k"
server_key: "b20dcf3d3677ddacbf792454bc58c1b1"
server_key_iv: "eafc66be057a6e4dad30732fad0c3698"
server_key_version: "encryptionkey@0"
I20260811 00:54:28.200502 32390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:28.201251 32416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:28.201413 32390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:28.201505 32390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "3d41d29bf7ae454590f7794e663a9101"
format_stamp: "Formatted at 2026-08-11 00:54:28 on dist-test-slave-xt4k"
server_key: "b20dcf3d3677ddacbf792454bc58c1b1"
server_key_iv: "eafc66be057a6e4dad30732fad0c3698"
server_key_version: "encryptionkey@0"
I20260811 00:54:28.201574 32390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:28.216413 32390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:28.218472 32390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:28.218608 32390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:28.222399 32390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37613
I20260811 00:54:28.222434 32514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37613 every 8 connection(s)
I20260811 00:54:28.222771 32390 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:28.223598 32521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:28.225880 32521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101: Bootstrap starting.
I20260811 00:54:28.226413 32521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:28.226670 32521 log.cc:824] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:28.227319 32521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101: No bootstrap required, opened a new log
I20260811 00:54:28.227588 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32390
I20260811 00:54:28.227687 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:28.227861 27022 external_mini_cluster.cc:1428] Setting key 9827e5171c5df78695530e7e9672eb9b
I20260811 00:54:28.229125 32521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260811 00:54:28.229271 32521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:28.229307 32521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d41d29bf7ae454590f7794e663a9101, State: Initialized, Role: FOLLOWER
I20260811 00:54:28.229430 32521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260811 00:54:28.229508 32521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:28.229557 32521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:28.229602 32521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:28.230499 32521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260811 00:54:28.230607 32521 leader_election.cc:302] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d41d29bf7ae454590f7794e663a9101; no voters:
I20260811 00:54:28.230752 32521 leader_election.cc:288] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:28.230785 32527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:28.230885 32527 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [term 1 LEADER]: Becoming Leader. State: Replica: 3d41d29bf7ae454590f7794e663a9101, State: Running, Role: LEADER
I20260811 00:54:28.231007 32521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:28.231035 32527 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260811 00:54:28.231487 32527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d41d29bf7ae454590f7794e663a9101. Latest consensus state: current_term: 1 leader_uuid: "3d41d29bf7ae454590f7794e663a9101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } } }
I20260811 00:54:28.231583 32527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:28.231900 32532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d41d29bf7ae454590f7794e663a9101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d41d29bf7ae454590f7794e663a9101" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } } }
I20260811 00:54:28.232005 32532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:28.232483 32542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:28.232949 32542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:28.234701 32542 catalog_manager.cc:1347] Generated new cluster ID: 9f3bdf7bfe3941819f6810fbdc6d8de1
I20260811 00:54:28.234745 32542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32365](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:54:28.238915 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:28.228329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55071 (local address 127.0.0.1:37613)
0811 00:54:28.228510 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:28.228517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:28.228542 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:54:28.229091 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:28.229096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:28.229138 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:28.229241 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:28.229989 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:28.231000 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:28.231963 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:28.232585 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:28.232724 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:28.235262 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:28.235266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:28.235266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:28.235277 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:28.237152 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:28.237509 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:28.237512 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:28.237513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:28.237647 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:28.237824 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:28.237824 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:28.237825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:28.238165 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:28.238338 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:28.238404 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 00:54:28.238543 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260811 00:54:28.240057 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:28.251209 32526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:28.244576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41941 (local address 127.0.0.1:37613)
0811 00:54:28.244609 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:28.244611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:28.244706 (+ 95us) server_negotiation.cc:407] Connection header received
0811 00:54:28.244746 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:28.244747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:28.244757 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:28.244816 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:28.245353 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:28.246097 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:28.247038 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:28.247359 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:28.247419 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:28.248635 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:28.248636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:28.248637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:28.248644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:28.250136 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:28.250490 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:28.250490 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:28.250491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:28.250545 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:28.250719 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:28.250720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:28.250720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:28.250839 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:28.250928 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:28.251050 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 00:54:28.251125 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 00:54:28.251295 32542 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:28.252157 32542 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:28.263551 32542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d41d29bf7ae454590f7794e663a9101: Generated new TSK 0
I20260811 00:54:28.263724 32542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:28.268903 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32390
2026-08-11T00:54:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1469 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32584](info): set up 2 sockets
Aug 11 00:54:28 dist-test-slave-xt4k krb5kdc[32584](info): commencing operation
krb5kdc: starting...
W20260811 00:54:29.475486 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:29 dist-test-slave-xt4k krb5kdc[32584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:29.590679 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45341
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45341
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:29.671835 32613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:29.672042 32613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:29.672063 32613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:29.673194 32613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:29.673235 32613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:29.673249 32613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:29.673259 32613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:29.673270 32613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:29.674723 32613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45341
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45341
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:29.674923 32613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:29.675096 32613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:29.679694 32628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:29.679780 32613 server_base.cc:1034] running on GCE node
W20260811 00:54:29.679733 32631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:29.679752 32627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:29.680114 32613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:29.680434 32613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:29.681602 32613 hybrid_clock.cc:648] HybridClock initialized: now 1786409669681585 us; error 34 us; skew 500 ppm
Aug 11 00:54:29 dist-test-slave-xt4k krb5kdc[32584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409669, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:29.684073 32613 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:29.684571 32613 webserver.cc:460] Webserver started at http://127.0.0.1:34111/ using document root <none> and password file <none>
I20260811 00:54:29.684779 32613 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:29.684823 32613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:29.684945 32613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:29.685969 32613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "6f0075a73d9e4c25b42a6fa03a621ba2"
format_stamp: "Formatted at 2026-08-11 00:54:29 on dist-test-slave-xt4k"
server_key: "828574eb6fc7008da907e295e63ef554"
server_key_iv: "467e87ef9a5a1631bc87ee8cb50be976"
server_key_version: "encryptionkey@0"
I20260811 00:54:29.686299 32613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "6f0075a73d9e4c25b42a6fa03a621ba2"
format_stamp: "Formatted at 2026-08-11 00:54:29 on dist-test-slave-xt4k"
server_key: "828574eb6fc7008da907e295e63ef554"
server_key_iv: "467e87ef9a5a1631bc87ee8cb50be976"
server_key_version: "encryptionkey@0"
I20260811 00:54:29.687544 32613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:29.688215 32647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:29.688412 32613 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:29.688504 32613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "6f0075a73d9e4c25b42a6fa03a621ba2"
format_stamp: "Formatted at 2026-08-11 00:54:29 on dist-test-slave-xt4k"
server_key: "828574eb6fc7008da907e295e63ef554"
server_key_iv: "467e87ef9a5a1631bc87ee8cb50be976"
server_key_version: "encryptionkey@0"
I20260811 00:54:29.688572 32613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:29.704130 32613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:29.705940 32613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:29.706072 32613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:29.709990 32613 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45341
I20260811 00:54:29.710029 32739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45341 every 8 connection(s)
I20260811 00:54:29.710358 32613 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:29.711212 32741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:29.713508 32741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2: Bootstrap starting.
I20260811 00:54:29.714032 32741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:29.714277 32741 log.cc:824] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:29.715016 32741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2: No bootstrap required, opened a new log
I20260811 00:54:29.715520 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 32613
I20260811 00:54:29.715637 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:29.715849 27022 external_mini_cluster.cc:1428] Setting key a8af5ec145ed2aa7832dc8bfcc14df7e
I20260811 00:54:29.717163 32741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } }
I20260811 00:54:29.717301 32741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:29.717322 32741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0075a73d9e4c25b42a6fa03a621ba2, State: Initialized, Role: FOLLOWER
I20260811 00:54:29.717427 32741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } }
I20260811 00:54:29.717495 32741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:29.717517 32741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:29.717572 32741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:29.718165 32741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } }
I20260811 00:54:29.718266 32741 leader_election.cc:302] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f0075a73d9e4c25b42a6fa03a621ba2; no voters:
I20260811 00:54:29.718421 32741 leader_election.cc:288] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:29.718459 32754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:29.718619 32754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 6f0075a73d9e4c25b42a6fa03a621ba2, State: Running, Role: LEADER
I20260811 00:54:29.718698 32741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:29.718792 32754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } }
I20260811 00:54:29.719129 32754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f0075a73d9e4c25b42a6fa03a621ba2. Latest consensus state: current_term: 1 leader_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } } }
I20260811 00:54:29.719141 32757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f0075a73d9e4c25b42a6fa03a621ba2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45341 } } }
I20260811 00:54:29.719280 32754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:29.719291 32757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:29.719599 32767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:29.720150 32767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:29.721800 32767 catalog_manager.cc:1347] Generated new cluster ID: 8b5f303453ae44f18d7406253d4fc1c9
I20260811 00:54:29.721853 32767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:29.722152 32748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:29.716413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47495 (local address 127.0.0.1:45341)
0811 00:54:29.716562 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:29.716569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:29.716598 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:54:29.717330 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:29.717339 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:29.717433 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:29.717583 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:29.717874 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:29.719051 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:29.720121 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:29.720755 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:29.720856 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:29.721509 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:29.721513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:29.721513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:29.721681 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:29.721718 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:29.721734 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:29.721790 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:29.721889 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 00:54:29.721960 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260811 00:54:29.724800 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:29.731472 32748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:29.728658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53221 (local address 127.0.0.1:45341)
0811 00:54:29.728701 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:29.728703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:29.728824 (+ 121us) server_negotiation.cc:407] Connection header received
0811 00:54:29.728879 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:29.728880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:29.728891 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:29.728948 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:29.729064 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:29.729525 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:29.730256 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:29.730447 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:29.730499 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:29.731087 (+ 588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:29.731088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:29.731089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:29.731093 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:29.731108 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:29.731112 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:29.731153 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:29.731379 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 00:54:29.731402 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:54:29.731681 32767 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:29.732431 32767 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:29.735939 32767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f0075a73d9e4c25b42a6fa03a621ba2: Generated new TSK 0
I20260811 00:54:29.736097 32767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:29.738932 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 32613
2026-08-11T00:54:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:29 dist-test-slave-xt4k krb5kdc[328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:29 dist-test-slave-xt4k krb5kdc[328](info): set up 2 sockets
Aug 11 00:54:29 dist-test-slave-xt4k krb5kdc[328](info): commencing operation
krb5kdc: starting...
W20260811 00:54:30.937376 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:31 dist-test-slave-xt4k krb5kdc[328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:31.052847 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:31.133858 355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:31.134060 355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:31.134091 355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:31.135201 355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:31.135241 355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:31.135259 355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:31.135275 355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:31.135291 355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:31.136775 355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:31.137014 355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:31.137214 355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:31.141781 369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:31.141837 365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:31.141795 363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:31.141981 355 server_base.cc:1034] running on GCE node
I20260811 00:54:31.142185 355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:31.142429 355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:31.143586 355 hybrid_clock.cc:648] HybridClock initialized: now 1786409671143569 us; error 27 us; skew 500 ppm
Aug 11 00:54:31 dist-test-slave-xt4k krb5kdc[328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409671, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:31.145973 355 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:31.146384 355 webserver.cc:460] Webserver started at http://127.0.0.1:34723/ using document root <none> and password file <none>
I20260811 00:54:31.146561 355 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:31.146600 355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:31.146690 355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:31.147660 355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "d7efcb6fb13943a590743eea92b1df1e"
format_stamp: "Formatted at 2026-08-11 00:54:31 on dist-test-slave-xt4k"
server_key: "9b4a15dcb75339f863b14e19015ad9e0"
server_key_iv: "8d759a51e4c905faf9a50a3b5b5a816f"
server_key_version: "encryptionkey@0"
I20260811 00:54:31.147944 355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "d7efcb6fb13943a590743eea92b1df1e"
format_stamp: "Formatted at 2026-08-11 00:54:31 on dist-test-slave-xt4k"
server_key: "9b4a15dcb75339f863b14e19015ad9e0"
server_key_iv: "8d759a51e4c905faf9a50a3b5b5a816f"
server_key_version: "encryptionkey@0"
I20260811 00:54:31.149158 355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:31.149813 385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:31.150007 355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:31.150094 355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "d7efcb6fb13943a590743eea92b1df1e"
format_stamp: "Formatted at 2026-08-11 00:54:31 on dist-test-slave-xt4k"
server_key: "9b4a15dcb75339f863b14e19015ad9e0"
server_key_iv: "8d759a51e4c905faf9a50a3b5b5a816f"
server_key_version: "encryptionkey@0"
I20260811 00:54:31.150149 355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:31.153266 355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:31.155146 355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:31.155247 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:31.158984 355 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35877
I20260811 00:54:31.159017 494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35877 every 8 connection(s)
I20260811 00:54:31.159296 355 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:31.160110 497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:31.162284 497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: Bootstrap starting.
I20260811 00:54:31.162864 497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:31.163130 497 log.cc:824] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:31.163772 497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: No bootstrap required, opened a new log
I20260811 00:54:31.165385 497 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } }
I20260811 00:54:31.165526 497 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:31.165563 497 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7efcb6fb13943a590743eea92b1df1e, State: Initialized, Role: FOLLOWER
I20260811 00:54:31.165693 497 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } }
I20260811 00:54:31.165771 497 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:31.165810 497 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:31.165858 497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:31.166353 497 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } }
I20260811 00:54:31.166450 497 leader_election.cc:302] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7efcb6fb13943a590743eea92b1df1e; no voters:
I20260811 00:54:31.166620 497 leader_election.cc:288] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:31.166656 506 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:31.166781 506 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [term 1 LEADER]: Becoming Leader. State: Replica: d7efcb6fb13943a590743eea92b1df1e, State: Running, Role: LEADER
I20260811 00:54:31.166887 497 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:31.166922 506 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } }
I20260811 00:54:31.167364 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 355
I20260811 00:54:31.167474 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:31.167683 27022 external_mini_cluster.cc:1428] Setting key b1603ff69d7913d2499b64332b70f3ca
I20260811 00:54:31.168133 508 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7efcb6fb13943a590743eea92b1df1e. Latest consensus state: current_term: 1 leader_uuid: "d7efcb6fb13943a590743eea92b1df1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } } }
I20260811 00:54:31.168141 507 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7efcb6fb13943a590743eea92b1df1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7efcb6fb13943a590743eea92b1df1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35877 } } }
I20260811 00:54:31.168238 508 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:31.168244 507 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e [sys.catalog]: This master's current role is: LEADER
W20260811 00:54:31.168890 534 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:31.168987 534 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:31.169094 533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:31.169294 533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:31.170881 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:31.168117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39243 (local address 127.0.0.1:35877)
0811 00:54:31.168599 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:31.168608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:31.168958 (+ 350us) server_negotiation.cc:407] Connection header received
0811 00:54:31.169089 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:31.169097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:31.169128 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:31.169262 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:31.170281 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:31.170284 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:31.170285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:31.170289 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:31.170330 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:31.170345 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:31.170424 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:31.170661 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 00:54:31.170704 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":67,"threads_started":1}
I20260811 00:54:31.170940 533 catalog_manager.cc:1347] Generated new cluster ID: 4ad6c7ee71a540f482c5e9c552dbc308
I20260811 00:54:31.170982 533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:31.171711 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:31.174238 529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:31.173266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46357 (local address 127.0.0.1:35877)
0811 00:54:31.173297 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:31.173298 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:31.173306 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:31.173327 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:31.173328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:31.173332 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:31.173396 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:31.174038 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:31.174039 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:31.174039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:31.174043 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:31.174059 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:31.174064 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:31.174127 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:31.174165 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 00:54:31.174177 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 00:54:31.179523 533 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:31.179672 533 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:31.184576 533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7efcb6fb13943a590743eea92b1df1e: Generated new TSK 0
I20260811 00:54:31.184733 533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:31.191018 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 355
2026-08-11T00:54:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:31 dist-test-slave-xt4k krb5kdc[550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:31 dist-test-slave-xt4k krb5kdc[550](info): set up 2 sockets
Aug 11 00:54:31 dist-test-slave-xt4k krb5kdc[550](info): commencing operation
krb5kdc: starting...
W20260811 00:54:32.401448 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:32.516168 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:32.596104 571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:32.596295 571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:32.596325 571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:32.597461 571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:32.597502 571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:32.597520 571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:32.597535 571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:32.597553 571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:32.599035 571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:32.599268 571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:32.599471 571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:32.604022 582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:32.604066 580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:32.604029 579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:32.604121 571 server_base.cc:1034] running on GCE node
I20260811 00:54:32.604472 571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:32.604735 571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:32.605870 571 hybrid_clock.cc:648] HybridClock initialized: now 1786409672605856 us; error 30 us; skew 500 ppm
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409672, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:32.608206 571 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:32.608625 571 webserver.cc:460] Webserver started at http://127.0.0.1:36399/ using document root <none> and password file <none>
I20260811 00:54:32.608839 571 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:32.608887 571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:32.609016 571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:32.609982 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "eda2cd01e46846e7b0ba60365a30df71"
format_stamp: "Formatted at 2026-08-11 00:54:32 on dist-test-slave-xt4k"
server_key: "0fba1f512c8914cf7aa1943fa8e4ff61"
server_key_iv: "4835bdd9de39fa193378a2369394ae5e"
server_key_version: "encryptionkey@0"
I20260811 00:54:32.610324 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "eda2cd01e46846e7b0ba60365a30df71"
format_stamp: "Formatted at 2026-08-11 00:54:32 on dist-test-slave-xt4k"
server_key: "0fba1f512c8914cf7aa1943fa8e4ff61"
server_key_iv: "4835bdd9de39fa193378a2369394ae5e"
server_key_version: "encryptionkey@0"
I20260811 00:54:32.611526 571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:32.612447 595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:32.612617 571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 00:54:32.612723 571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "eda2cd01e46846e7b0ba60365a30df71"
format_stamp: "Formatted at 2026-08-11 00:54:32 on dist-test-slave-xt4k"
server_key: "0fba1f512c8914cf7aa1943fa8e4ff61"
server_key_iv: "4835bdd9de39fa193378a2369394ae5e"
server_key_version: "encryptionkey@0"
I20260811 00:54:32.612794 571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:32.638628 571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:32.640789 571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:32.640933 571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:32.644807 571 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33487
I20260811 00:54:32.644842 710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33487 every 8 connection(s)
I20260811 00:54:32.645176 571 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:32.646020 711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:32.648222 711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71: Bootstrap starting.
I20260811 00:54:32.648805 711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:32.649041 711 log.cc:824] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:32.649652 711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71: No bootstrap required, opened a new log
I20260811 00:54:32.650647 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 571
I20260811 00:54:32.650761 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:32.650929 27022 external_mini_cluster.cc:1428] Setting key 2590357b06a33ee5508bbe1582ced54b
I20260811 00:54:32.651301 711 raft_consensus.cc:348] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } }
I20260811 00:54:32.651552 711 raft_consensus.cc:374] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:32.651619 711 raft_consensus.cc:729] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda2cd01e46846e7b0ba60365a30df71, State: Initialized, Role: FOLLOWER
I20260811 00:54:32.651747 711 consensus_queue.cc:260] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } }
I20260811 00:54:32.651818 711 raft_consensus.cc:388] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:32.651839 711 raft_consensus.cc:482] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:32.651886 711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:32.652598 711 raft_consensus.cc:504] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } }
I20260811 00:54:32.652719 711 leader_election.cc:302] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eda2cd01e46846e7b0ba60365a30df71; no voters:
I20260811 00:54:32.652884 711 leader_election.cc:288] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:32.652904 717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:32.653019 717 raft_consensus.cc:686] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [term 1 LEADER]: Becoming Leader. State: Replica: eda2cd01e46846e7b0ba60365a30df71, State: Running, Role: LEADER
I20260811 00:54:32.653172 711 sys_catalog.cc:564] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:32.653156 717 consensus_queue.cc:237] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } }
I20260811 00:54:32.653496 717 sys_catalog.cc:455] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eda2cd01e46846e7b0ba60365a30df71. Latest consensus state: current_term: 1 leader_uuid: "eda2cd01e46846e7b0ba60365a30df71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } } }
I20260811 00:54:32.653717 717 sys_catalog.cc:458] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:32.653649 720 sys_catalog.cc:455] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eda2cd01e46846e7b0ba60365a30df71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eda2cd01e46846e7b0ba60365a30df71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33487 } } }
I20260811 00:54:32.654121 720 sys_catalog.cc:458] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:32.654299 731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:32.654837 731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:32.656538 731 catalog_manager.cc:1347] Generated new cluster ID: d4a4f81581f84dd2947421c0461b9824
I20260811 00:54:32.656594 731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:54:32.661255 716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:32.651551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:51361 (local address 127.0.0.1:33487)
0811 00:54:32.651747 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:32.651757 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:32.651789 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:54:32.651915 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:32.651922 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:32.651979 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:32.652090 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:32.652871 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:32.654249 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:32.655293 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:32.655883 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:32.655984 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:32.658213 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:32.658217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:32.658218 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:32.658230 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:32.659711 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:32.660072 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:32.660075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:32.660075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:32.660166 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:32.660391 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:32.660391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:32.660392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:32.660631 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:32.660800 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:32.660894 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 00:54:32.660993 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260811 00:54:32.662204 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:32.670293 716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:32.664661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:41793 (local address 127.0.0.1:33487)
0811 00:54:32.664700 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:32.664702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:32.664772 (+ 70us) server_negotiation.cc:407] Connection header received
0811 00:54:32.664825 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:32.664826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:32.664836 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:32.664879 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:32.665390 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:32.665870 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:32.666546 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:32.666770 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:32.666824 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:32.667857 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:32.667858 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:32.667858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:32.667865 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:32.669099 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:32.669426 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:32.669427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:32.669428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:32.669482 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:32.669676 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:32.669677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:32.669677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:32.669866 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:32.669990 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:32.670143 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 00:54:32.670205 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:54:32.673506 731 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:32.674059 731 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:32.681236 731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eda2cd01e46846e7b0ba60365a30df71: Generated new TSK 0
I20260811 00:54:32.681406 731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:32.689111 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 571
W20260811 00:54:32.707167 547 connection.cc:535] client connection to 127.0.0.1:33487 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33487): Connection reset by peer (error 104)
2026-08-11T00:54:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[758](info): set up 2 sockets
Aug 11 00:54:32 dist-test-slave-xt4k krb5kdc[758](info): commencing operation
krb5kdc: starting...
W20260811 00:54:33.885043 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:33 dist-test-slave-xt4k krb5kdc[758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:34.003234 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43973
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43973
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:34.084164 784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:34.084404 784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:34.084429 784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:34.085542 784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:34.085574 784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:34.085587 784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:34.085597 784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:34.085608 784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:34.087070 784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43973
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:34.087275 784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:34.087460 784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:34.092233 797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:34.092214 796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:34.092217 801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:34.092470 784 server_base.cc:1034] running on GCE node
I20260811 00:54:34.092731 784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:34.093015 784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:34.094162 784 hybrid_clock.cc:648] HybridClock initialized: now 1786409674094147 us; error 31 us; skew 500 ppm
Aug 11 00:54:34 dist-test-slave-xt4k krb5kdc[758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409674, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:34.099676 784 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:34.100121 784 webserver.cc:460] Webserver started at http://127.0.0.1:34043/ using document root <none> and password file <none>
I20260811 00:54:34.100329 784 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:34.100419 784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:34.100560 784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:34.101590 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "a1f9992e309d41728e59286ca32eb371"
format_stamp: "Formatted at 2026-08-11 00:54:34 on dist-test-slave-xt4k"
server_key: "542d95001f9f3eb3233f04846be3cd60"
server_key_iv: "0982c36a8a2c2746dba40fca63c328b2"
server_key_version: "encryptionkey@0"
I20260811 00:54:34.101918 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "a1f9992e309d41728e59286ca32eb371"
format_stamp: "Formatted at 2026-08-11 00:54:34 on dist-test-slave-xt4k"
server_key: "542d95001f9f3eb3233f04846be3cd60"
server_key_iv: "0982c36a8a2c2746dba40fca63c328b2"
server_key_version: "encryptionkey@0"
I20260811 00:54:34.103215 784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:34.103991 817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:34.104144 784 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:34.104245 784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "a1f9992e309d41728e59286ca32eb371"
format_stamp: "Formatted at 2026-08-11 00:54:34 on dist-test-slave-xt4k"
server_key: "542d95001f9f3eb3233f04846be3cd60"
server_key_iv: "0982c36a8a2c2746dba40fca63c328b2"
server_key_version: "encryptionkey@0"
I20260811 00:54:34.104314 784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:34.112068 784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:34.114427 784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:34.114590 784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:34.118768 784 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43973
I20260811 00:54:34.118845 927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43973 every 8 connection(s)
I20260811 00:54:34.119158 784 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:34.120044 928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:34.122311 928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371: Bootstrap starting.
I20260811 00:54:34.122869 928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:34.123142 928 log.cc:824] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:34.123806 928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371: No bootstrap required, opened a new log
I20260811 00:54:34.125402 928 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } }
I20260811 00:54:34.125545 928 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:34.125567 928 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1f9992e309d41728e59286ca32eb371, State: Initialized, Role: FOLLOWER
I20260811 00:54:34.125694 928 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } }
I20260811 00:54:34.125758 928 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:34.125782 928 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:34.125828 928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:34.126338 928 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } }
I20260811 00:54:34.126427 928 leader_election.cc:302] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1f9992e309d41728e59286ca32eb371; no voters:
I20260811 00:54:34.126588 928 leader_election.cc:288] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:34.126663 931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:34.126825 928 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:34.126835 931 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [term 1 LEADER]: Becoming Leader. State: Replica: a1f9992e309d41728e59286ca32eb371, State: Running, Role: LEADER
I20260811 00:54:34.127005 931 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } }
I20260811 00:54:34.127529 938 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1f9992e309d41728e59286ca32eb371. Latest consensus state: current_term: 1 leader_uuid: "a1f9992e309d41728e59286ca32eb371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } } }
I20260811 00:54:34.127624 938 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:34.127825 932 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1f9992e309d41728e59286ca32eb371" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1f9992e309d41728e59286ca32eb371" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43973 } } }
I20260811 00:54:34.127907 932 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:34.127940 955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:34.128427 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 784
I20260811 00:54:34.128458 955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:34.128533 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:34.128752 27022 external_mini_cluster.cc:1428] Setting key 7e07bf2a35b5149909152eae41c9e74a
I20260811 00:54:34.129930 955 catalog_manager.cc:1347] Generated new cluster ID: c76ba23072714335a16f653f351beef3
I20260811 00:54:34.129997 955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:34.136240 974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:34.129186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:51419 (local address 127.0.0.1:43973)
0811 00:54:34.129676 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:34.129685 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:34.129714 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:54:34.129830 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:34.129837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:34.132455 (+ 2618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:34.132594 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:34.132814 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:34.133746 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:34.134497 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:34.134895 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:34.134992 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:34.135653 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:34.135656 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:34.135656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:34.135816 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:34.135847 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:34.135858 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:34.135925 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:34.136024 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 00:54:34.136055 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":62,"threads_started":1}
I20260811 00:54:34.137130 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:34.143445 974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:34.140684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:35431 (local address 127.0.0.1:43973)
0811 00:54:34.140725 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:34.140728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:34.140851 (+ 123us) server_negotiation.cc:407] Connection header received
0811 00:54:34.140896 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:34.140897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:34.140908 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:34.140957 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:34.141090 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:34.141604 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:34.142327 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:34.142551 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:34.142606 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:34.143215 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:34.143216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:34.143217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:34.143221 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:34.143235 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:34.143241 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:34.143283 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:34.143350 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 00:54:34.143361 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 00:54:34.145696 955 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:34.146170 955 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:34.156195 955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1f9992e309d41728e59286ca32eb371: Generated new TSK 0
I20260811 00:54:34.156458 955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:34.165203 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 784
W20260811 00:54:34.186622 754 connection.cc:535] client connection to 127.0.0.1:43973 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43973): Connection reset by peer (error 104)
2026-08-11T00:54:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:34 dist-test-slave-xt4k krb5kdc[985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:34 dist-test-slave-xt4k krb5kdc[985](info): set up 2 sockets
Aug 11 00:54:34 dist-test-slave-xt4k krb5kdc[985](info): commencing operation
krb5kdc: starting...
W20260811 00:54:35.364764 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:35 dist-test-slave-xt4k krb5kdc[985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:35.483407 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35895
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:35.562959 1013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:35.563150 1013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:35.563180 1013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:35.564284 1013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:35.564323 1013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:35.564361 1013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:35.564380 1013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:35.564404 1013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:35.565853 1013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:35.566087 1013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:35.566282 1013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:35.570724 1032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:35.570850 1013 server_base.cc:1034] running on GCE node
W20260811 00:54:35.570735 1023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:35.570750 1028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:35.571178 1013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:35.571455 1013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:35.572587 1013 hybrid_clock.cc:648] HybridClock initialized: now 1786409675572570 us; error 36 us; skew 500 ppm
Aug 11 00:54:35 dist-test-slave-xt4k krb5kdc[985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:35.574889 1013 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:35.575289 1013 webserver.cc:460] Webserver started at http://127.0.0.1:41679/ using document root <none> and password file <none>
I20260811 00:54:35.575516 1013 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:35.575565 1013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:35.575687 1013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:35.576690 1013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "bdc298758b6043c59cc591f0fd965ec5"
format_stamp: "Formatted at 2026-08-11 00:54:35 on dist-test-slave-xt4k"
server_key: "fe54093bef999f9758475f019d9b517a"
server_key_iv: "cbebbb23a43b82659507fdea81391c64"
server_key_version: "encryptionkey@0"
I20260811 00:54:35.576992 1013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "bdc298758b6043c59cc591f0fd965ec5"
format_stamp: "Formatted at 2026-08-11 00:54:35 on dist-test-slave-xt4k"
server_key: "fe54093bef999f9758475f019d9b517a"
server_key_iv: "cbebbb23a43b82659507fdea81391c64"
server_key_version: "encryptionkey@0"
I20260811 00:54:35.578146 1013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:35.578872 1044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:35.579006 1013 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:35.579090 1013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "bdc298758b6043c59cc591f0fd965ec5"
format_stamp: "Formatted at 2026-08-11 00:54:35 on dist-test-slave-xt4k"
server_key: "fe54093bef999f9758475f019d9b517a"
server_key_iv: "cbebbb23a43b82659507fdea81391c64"
server_key_version: "encryptionkey@0"
I20260811 00:54:35.579154 1013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:35.582242 1013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:35.584168 1013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:35.584292 1013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:35.587940 1013 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35895
I20260811 00:54:35.587977 1149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35895 every 8 connection(s)
I20260811 00:54:35.588261 1013 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:35.589077 1150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:35.591188 1150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5: Bootstrap starting.
I20260811 00:54:35.591729 1150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:35.591980 1150 log.cc:824] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:35.592610 1150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5: No bootstrap required, opened a new log
I20260811 00:54:35.594379 1150 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } }
I20260811 00:54:35.594529 1150 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:35.594551 1150 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdc298758b6043c59cc591f0fd965ec5, State: Initialized, Role: FOLLOWER
I20260811 00:54:35.594694 1150 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } }
I20260811 00:54:35.594761 1150 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:35.594782 1150 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:35.594810 1150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:35.595314 1150 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } }
I20260811 00:54:35.595413 1150 leader_election.cc:302] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdc298758b6043c59cc591f0fd965ec5; no voters:
I20260811 00:54:35.595562 1150 leader_election.cc:288] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:35.595609 1154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:35.595769 1154 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [term 1 LEADER]: Becoming Leader. State: Replica: bdc298758b6043c59cc591f0fd965ec5, State: Running, Role: LEADER
I20260811 00:54:35.595798 1150 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:35.595857 1154 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } }
I20260811 00:54:35.596220 1155 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdc298758b6043c59cc591f0fd965ec5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } } }
I20260811 00:54:35.596236 1156 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdc298758b6043c59cc591f0fd965ec5. Latest consensus state: current_term: 1 leader_uuid: "bdc298758b6043c59cc591f0fd965ec5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc298758b6043c59cc591f0fd965ec5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35895 } } }
I20260811 00:54:35.596375 1155 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:35.596451 1156 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:35.596812 1162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:35.597348 1162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:35.597972 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1013
I20260811 00:54:35.598084 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:35.598253 27022 external_mini_cluster.cc:1428] Setting key d47e2311c5b3b5bd726d752bb7b17b50
I20260811 00:54:35.599786 1162 catalog_manager.cc:1347] Generated new cluster ID: 4aa9d4bad16d4cac9b8cb45db38c0dd4
I20260811 00:54:35.599838 1162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:35.600319 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:35.598701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:43119 (local address 127.0.0.1:35895)
0811 00:54:35.598871 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:35.598880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:35.598932 (+ 52us) server_negotiation.cc:407] Connection header received
0811 00:54:35.599043 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:35.599048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:35.599070 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:35.599180 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:35.599857 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:35.599861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:35.599861 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:35.599867 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:35.599907 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:35.599921 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:35.599996 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:35.600078 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 00:54:35.600123 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
I20260811 00:54:35.601179 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:35.605371 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:35.602573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:37479 (local address 127.0.0.1:35895)
0811 00:54:35.602605 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:35.602607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:35.604513 (+ 1906us) server_negotiation.cc:407] Connection header received
0811 00:54:35.604582 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:35.604583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:35.604588 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:35.604636 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:35.605190 (+ 554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:35.605191 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:35.605191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:35.605194 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:35.605204 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:35.605208 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:35.605248 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:35.605301 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 00:54:35.605312 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 00:54:35.615195 1162 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:35.615356 1162 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:35.619831 1162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdc298758b6043c59cc591f0fd965ec5: Generated new TSK 0
I20260811 00:54:35.620033 1162 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:35.625587 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1013
2026-08-11T00:54:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1454 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:35 dist-test-slave-xt4k krb5kdc[1214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:35 dist-test-slave-xt4k krb5kdc[1214](info): set up 2 sockets
Aug 11 00:54:35 dist-test-slave-xt4k krb5kdc[1214](info): commencing operation
krb5kdc: starting...
W20260811 00:54:36.811918 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:36 dist-test-slave-xt4k krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:36.927317 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46153
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:37.009094 1236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:37.009297 1236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:37.009320 1236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:37.010404 1236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:37.010440 1236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:37.010452 1236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:37.010463 1236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:37.010474 1236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:37.011897 1236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46153
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:37.012117 1236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:37.012295 1236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:37.017108 1244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:37.017086 1245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:37.017068 1249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:37.017119 1236 server_base.cc:1034] running on GCE node
I20260811 00:54:37.017489 1236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:37.017758 1236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:37.018891 1236 hybrid_clock.cc:648] HybridClock initialized: now 1786409677018878 us; error 31 us; skew 500 ppm
Aug 11 00:54:37 dist-test-slave-xt4k krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409677, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:37.021448 1236 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:37.021899 1236 webserver.cc:460] Webserver started at http://127.0.0.1:38425/ using document root <none> and password file <none>
I20260811 00:54:37.022130 1236 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:37.022179 1236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:37.022305 1236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:37.023520 1236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "8b7a5ab6c0764c7ba83576835d5b7a43"
format_stamp: "Formatted at 2026-08-11 00:54:37 on dist-test-slave-xt4k"
server_key: "47c656574f48ff4dd975ad2385729b9d"
server_key_iv: "72989297b804ae5f3298ed2b7d9ff6b0"
server_key_version: "encryptionkey@0"
I20260811 00:54:37.023865 1236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "8b7a5ab6c0764c7ba83576835d5b7a43"
format_stamp: "Formatted at 2026-08-11 00:54:37 on dist-test-slave-xt4k"
server_key: "47c656574f48ff4dd975ad2385729b9d"
server_key_iv: "72989297b804ae5f3298ed2b7d9ff6b0"
server_key_version: "encryptionkey@0"
I20260811 00:54:37.025193 1236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:37.025868 1264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:37.026026 1236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:37.026113 1236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "8b7a5ab6c0764c7ba83576835d5b7a43"
format_stamp: "Formatted at 2026-08-11 00:54:37 on dist-test-slave-xt4k"
server_key: "47c656574f48ff4dd975ad2385729b9d"
server_key_iv: "72989297b804ae5f3298ed2b7d9ff6b0"
server_key_version: "encryptionkey@0"
I20260811 00:54:37.026171 1236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:37.038769 1236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:37.040807 1236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:37.040943 1236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:37.044836 1236 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46153
I20260811 00:54:37.044879 1367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46153 every 8 connection(s)
I20260811 00:54:37.045192 1236 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:37.046028 1371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:37.048193 1371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: Bootstrap starting.
I20260811 00:54:37.048751 1371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:37.049013 1371 log.cc:824] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:37.049623 1371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: No bootstrap required, opened a new log
I20260811 00:54:37.051147 1371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } }
I20260811 00:54:37.051281 1371 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:37.051303 1371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b7a5ab6c0764c7ba83576835d5b7a43, State: Initialized, Role: FOLLOWER
I20260811 00:54:37.051432 1371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } }
I20260811 00:54:37.051491 1371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:37.051522 1371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:37.051568 1371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:37.052062 1371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } }
I20260811 00:54:37.052152 1371 leader_election.cc:302] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b7a5ab6c0764c7ba83576835d5b7a43; no voters:
I20260811 00:54:37.052302 1371 leader_election.cc:288] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:37.052354 1376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:37.052531 1376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [term 1 LEADER]: Becoming Leader. State: Replica: 8b7a5ab6c0764c7ba83576835d5b7a43, State: Running, Role: LEADER
I20260811 00:54:37.052567 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1236
I20260811 00:54:37.052577 1371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:37.052695 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:37.052714 1376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } }
I20260811 00:54:37.052878 27022 external_mini_cluster.cc:1428] Setting key 6dec7c7d6562d567f35f8709af58b1b7
I20260811 00:54:37.053682 1380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } } }
I20260811 00:54:37.053785 1380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:37.054133 1378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b7a5ab6c0764c7ba83576835d5b7a43. Latest consensus state: current_term: 1 leader_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b7a5ab6c0764c7ba83576835d5b7a43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46153 } } }
I20260811 00:54:37.054286 1378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43 [sys.catalog]: This master's current role is: LEADER
W20260811 00:54:37.054492 1413 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:37.054548 1413 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:37.054641 1408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:37.054836 1408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:37.056221 1408 catalog_manager.cc:1347] Generated new cluster ID: 4ea07d2364784c7c93bf1fd47ca57bd9
I20260811 00:54:37.056273 1408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:37 dist-test-slave-xt4k krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 00:54:37.064642 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:37.053356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:56559 (local address 127.0.0.1:46153)
0811 00:54:37.054243 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:37.054252 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:37.054287 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:54:37.054405 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:37.054411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:37.054507 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:37.054648 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:37.055373 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:37.056669 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:37.057724 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:37.058292 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:37.058388 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:37.061114 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:37.061119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:37.061119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:37.061133 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:37.062998 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:37.063403 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:37.063406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:37.063406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:37.063533 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:37.063732 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:37.063733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:37.063733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:37.064042 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:37.064201 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:37.064289 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 00:54:37.064421 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":65,"threads_started":1}
I20260811 00:54:37.065802 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:37.070982 1408 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:37.071614 1408 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:37.073994 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:37.067231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:60699 (local address 127.0.0.1:46153)
0811 00:54:37.067264 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:37.067266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:37.067367 (+ 101us) server_negotiation.cc:407] Connection header received
0811 00:54:37.067396 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:37.067397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:37.067406 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:37.067470 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:37.067992 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:37.068778 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:37.069742 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:37.070030 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:37.070099 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:37.071366 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:37.071367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:37.071368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:37.071374 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:37.072854 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:37.073240 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:37.073241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:37.073241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:37.073298 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:37.073488 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:37.073489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:37.073489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:37.073633 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:37.073728 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:37.073843 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 00:54:37.073906 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 00:54:37.079921 1408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b7a5ab6c0764c7ba83576835d5b7a43: Generated new TSK 0
I20260811 00:54:37.080091 1408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:37.083011 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1236
W20260811 00:54:37.098512 1211 connection.cc:535] client connection to 127.0.0.1:46153 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46153): Connection reset by peer (error 104)
2026-08-11T00:54:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:37 dist-test-slave-xt4k krb5kdc[1428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:37 dist-test-slave-xt4k krb5kdc[1428](info): set up 2 sockets
Aug 11 00:54:37 dist-test-slave-xt4k krb5kdc[1428](info): commencing operation
krb5kdc: starting...
W20260811 00:54:38.278385 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:38 dist-test-slave-xt4k krb5kdc[1428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:38.397280 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:38.478021 1450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:38.478219 1450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:38.478240 1450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:38.479375 1450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:38.479419 1450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:38.479432 1450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:38.479444 1450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:38.479455 1450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:38.480954 1450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:38.481173 1450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:38.481398 1450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:38.486052 1464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:38.486172 1450 server_base.cc:1034] running on GCE node
W20260811 00:54:38.486063 1469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:38.486280 1465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:38.486505 1450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:38.486788 1450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:38.487932 1450 hybrid_clock.cc:648] HybridClock initialized: now 1786409678487911 us; error 32 us; skew 500 ppm
Aug 11 00:54:38 dist-test-slave-xt4k krb5kdc[1428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409678, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:38.490366 1450 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:38.490823 1450 webserver.cc:460] Webserver started at http://127.0.0.1:43937/ using document root <none> and password file <none>
I20260811 00:54:38.491042 1450 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:38.491089 1450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:38.491211 1450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:38.492275 1450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e"
format_stamp: "Formatted at 2026-08-11 00:54:38 on dist-test-slave-xt4k"
server_key: "38d7440f42cec903fd49f7d046afd3cb"
server_key_iv: "4073cba7c58f9f3ada8142ab8fd959b5"
server_key_version: "encryptionkey@0"
I20260811 00:54:38.492676 1450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e"
format_stamp: "Formatted at 2026-08-11 00:54:38 on dist-test-slave-xt4k"
server_key: "38d7440f42cec903fd49f7d046afd3cb"
server_key_iv: "4073cba7c58f9f3ada8142ab8fd959b5"
server_key_version: "encryptionkey@0"
I20260811 00:54:38.493948 1450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:38.494807 1482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:38.495031 1450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:38.495128 1450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e"
format_stamp: "Formatted at 2026-08-11 00:54:38 on dist-test-slave-xt4k"
server_key: "38d7440f42cec903fd49f7d046afd3cb"
server_key_iv: "4073cba7c58f9f3ada8142ab8fd959b5"
server_key_version: "encryptionkey@0"
I20260811 00:54:38.495198 1450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:38.514017 1450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:38.515866 1450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:38.516003 1450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:38.519881 1450 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46137
I20260811 00:54:38.519935 1580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46137 every 8 connection(s)
I20260811 00:54:38.520258 1450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:38.521169 1581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:38.521840 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1450
I20260811 00:54:38.521943 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:38.522115 27022 external_mini_cluster.cc:1428] Setting key 12fd6e2568e4e329d763ddfa6c85f9e1
I20260811 00:54:38.524231 1581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e: Bootstrap starting.
I20260811 00:54:38.524952 1581 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:38.525255 1581 log.cc:824] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:38.525915 1581 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e: No bootstrap required, opened a new log
I20260811 00:54:38.527951 1590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:38.522630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:33335 (local address 127.0.0.1:46137)
0811 00:54:38.522825 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:38.522835 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:38.522870 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:54:38.523398 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:38.523407 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:38.523474 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:38.523622 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:38.523784 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:38.525127 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:38.525926 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:38.526498 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:38.526623 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:38.527277 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:38.527282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:38.527283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:38.527482 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:38.527536 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:38.527553 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:38.527646 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:38.527715 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 00:54:38.527744 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260811 00:54:38.528132 1581 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260811 00:54:38.528263 1581 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:38.528294 1581 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1e1845e4e1e4ed9938e5c2ffa66b31e, State: Initialized, Role: FOLLOWER
I20260811 00:54:38.528430 1581 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260811 00:54:38.528494 1581 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:38.528525 1581 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:38.528571 1581 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:38.528954 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:38.529137 1581 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260811 00:54:38.529240 1581 leader_election.cc:302] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1e1845e4e1e4ed9938e5c2ffa66b31e; no voters:
I20260811 00:54:38.529384 1581 leader_election.cc:288] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:38.529420 1592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:38.529580 1592 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [term 1 LEADER]: Becoming Leader. State: Replica: b1e1845e4e1e4ed9938e5c2ffa66b31e, State: Running, Role: LEADER
I20260811 00:54:38.529624 1581 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:38.529731 1592 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } }
I20260811 00:54:38.530076 1592 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1e1845e4e1e4ed9938e5c2ffa66b31e. Latest consensus state: current_term: 1 leader_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } } }
I20260811 00:54:38.530184 1597 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1e1845e4e1e4ed9938e5c2ffa66b31e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46137 } } }
I20260811 00:54:38.530262 1597 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:38.530197 1592 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:38.530478 1615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:38.530972 1615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:38.532698 1615 catalog_manager.cc:1347] Generated new cluster ID: e03095376cd847818d7c7b572f7faf4b
I20260811 00:54:38.532754 1615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:38.535384 1590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:38.531405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:58309 (local address 127.0.0.1:46137)
0811 00:54:38.531439 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:38.531441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:38.532082 (+ 641us) server_negotiation.cc:407] Connection header received
0811 00:54:38.532140 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:38.532141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:38.532151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:38.532211 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:38.532355 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:38.533044 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:38.534093 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:38.534403 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:38.534481 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:38.535153 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:38.535154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:38.535154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:38.535159 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:38.535176 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:38.535180 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:38.535243 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:38.535304 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 00:54:38.535315 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:54:38.537717 1615 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:38.538192 1615 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:38.540563 1615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1e1845e4e1e4ed9938e5c2ffa66b31e: Generated new TSK 0
I20260811 00:54:38.540730 1615 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:38.545630 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1450
W20260811 00:54:38.558291 1426 connection.cc:535] client connection to 127.0.0.1:46137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46137): Connection reset by peer (error 104)
2026-08-11T00:54:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:38 dist-test-slave-xt4k krb5kdc[1647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:38 dist-test-slave-xt4k krb5kdc[1647](info): set up 2 sockets
Aug 11 00:54:38 dist-test-slave-xt4k krb5kdc[1647](info): commencing operation
krb5kdc: starting...
W20260811 00:54:39.742452 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:39 dist-test-slave-xt4k krb5kdc[1647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 00:54:39.862802 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37007
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37007
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:39.945223 1671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:39.945434 1671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:39.945456 1671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:39.946586 1671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:39.946627 1671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:39.946640 1671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:39.946657 1671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:39.946668 1671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:39.948195 1671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37007
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:39.948467 1671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:39.948684 1671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:39.953372 1684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:39.953444 1687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:39.953480 1671 server_base.cc:1034] running on GCE node
W20260811 00:54:39.953444 1685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:39.953826 1671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:39.954123 1671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:39.955303 1671 hybrid_clock.cc:648] HybridClock initialized: now 1786409679955280 us; error 29 us; skew 500 ppm
Aug 11 00:54:39 dist-test-slave-xt4k krb5kdc[1647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409679, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:39.961474 1671 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 00:54:39.961901 1671 webserver.cc:460] Webserver started at http://127.0.0.1:34633/ using document root <none> and password file <none>
I20260811 00:54:39.962092 1671 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:39.962133 1671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:39.962226 1671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:39.963266 1671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "f3eac7801d4d42709ee8f0f3ceb22398"
format_stamp: "Formatted at 2026-08-11 00:54:39 on dist-test-slave-xt4k"
server_key: "562936e665caf94ab5d9e5b959a405d7"
server_key_iv: "42d6209ac92ebbbd2a4fe7dc3202b7b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:39.963569 1671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "f3eac7801d4d42709ee8f0f3ceb22398"
format_stamp: "Formatted at 2026-08-11 00:54:39 on dist-test-slave-xt4k"
server_key: "562936e665caf94ab5d9e5b959a405d7"
server_key_iv: "42d6209ac92ebbbd2a4fe7dc3202b7b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:39.964871 1671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:54:39.965616 1699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:39.965804 1671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 00:54:39.965896 1671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "f3eac7801d4d42709ee8f0f3ceb22398"
format_stamp: "Formatted at 2026-08-11 00:54:39 on dist-test-slave-xt4k"
server_key: "562936e665caf94ab5d9e5b959a405d7"
server_key_iv: "42d6209ac92ebbbd2a4fe7dc3202b7b8"
server_key_version: "encryptionkey@0"
I20260811 00:54:39.965948 1671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:39.969127 1671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:39.970942 1671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:39.971041 1671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:39.974715 1671 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37007
I20260811 00:54:39.974750 1801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37007 every 8 connection(s)
I20260811 00:54:39.975024 1671 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:39.975805 1802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:39.977483 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1671
I20260811 00:54:39.977588 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:39.977737 27022 external_mini_cluster.cc:1428] Setting key 7c031ccc4fe0d3609ff3cf93738e2ffd
I20260811 00:54:39.978147 1802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398: Bootstrap starting.
I20260811 00:54:39.978819 1802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:39.979079 1802 log.cc:824] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:39.979789 1802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398: No bootstrap required, opened a new log
I20260811 00:54:39.980145 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:39.978192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:42387 (local address 127.0.0.1:37007)
0811 00:54:39.978354 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:39.978362 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:39.978385 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:54:39.978803 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:39.978809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:39.978832 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:39.978958 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:39.979728 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:39.979731 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:39.979731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:39.979735 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:39.979770 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:39.979781 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:39.979862 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:39.979920 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 00:54:39.979957 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260811 00:54:39.981026 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:39.982158 1802 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } }
I20260811 00:54:39.982333 1802 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:39.982431 1802 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3eac7801d4d42709ee8f0f3ceb22398, State: Initialized, Role: FOLLOWER
I20260811 00:54:39.982570 1802 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } }
I20260811 00:54:39.982671 1802 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:39.982713 1802 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:39.982764 1802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:39.983435 1802 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } }
I20260811 00:54:39.983513 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:39.982556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.126:33103 (local address 127.0.0.1:37007)
0811 00:54:39.982597 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:39.982599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:39.982718 (+ 119us) server_negotiation.cc:407] Connection header received
0811 00:54:39.982832 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:39.982833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:39.982838 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:39.982889 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:39.983318 (+ 429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:39.983319 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:39.983319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:39.983322 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:39.983334 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:39.983337 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:39.983369 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:39.983431 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 00:54:39.983441 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:39.983566 1802 leader_election.cc:302] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3eac7801d4d42709ee8f0f3ceb22398; no voters:
I20260811 00:54:39.983708 1802 leader_election.cc:288] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:39.983753 1820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:39.983902 1820 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [term 1 LEADER]: Becoming Leader. State: Replica: f3eac7801d4d42709ee8f0f3ceb22398, State: Running, Role: LEADER
I20260811 00:54:39.983933 1802 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:39.984053 1820 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } }
I20260811 00:54:39.984416 1824 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } } }
I20260811 00:54:39.984519 1824 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:39.984405 1820 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3eac7801d4d42709ee8f0f3ceb22398. Latest consensus state: current_term: 1 leader_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3eac7801d4d42709ee8f0f3ceb22398" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37007 } } }
I20260811 00:54:39.984782 1820 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:39.984941 1836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:39.985440 1836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:39.987102 1836 catalog_manager.cc:1347] Generated new cluster ID: 21a01968e57d43ddb947d0ef295727ba
I20260811 00:54:39.987164 1836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:40.006811 1836 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:40.007001 1836 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:40.013680 1836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3eac7801d4d42709ee8f0f3ceb22398: Generated new TSK 0
I20260811 00:54:40.013862 1836 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:40.016470 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1671
2026-08-11T00:54:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1470 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:40 dist-test-slave-xt4k krb5kdc[1863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:40 dist-test-slave-xt4k krb5kdc[1863](info): set up 2 sockets
Aug 11 00:54:40 dist-test-slave-xt4k krb5kdc[1863](info): commencing operation
krb5kdc: starting...
W20260811 00:54:41.204373 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[1863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:41.319406 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:36391
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:36723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:41.399192 1889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:41.399395 1889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:41.399430 1889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:41.400563 1889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:41.400609 1889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:41.400630 1889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:41.400645 1889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:41.400662 1889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:41.402127 1889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:36723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:36391
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:41.402364 1889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:41.402577 1889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:41.407279 1908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:41.407253 1904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:41.407253 1897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:41.407277 1889 server_base.cc:1034] running on GCE node
I20260811 00:54:41.407733 1889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:41.408010 1889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:41.409168 1889 hybrid_clock.cc:648] HybridClock initialized: now 1786409681409152 us; error 29 us; skew 500 ppm
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[1863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409681, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:41.411535 1889 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:41.411996 1889 webserver.cc:460] Webserver started at http://127.26.99.190:43585/ using document root <none> and password file <none>
I20260811 00:54:41.412194 1889 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:41.412241 1889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:41.412396 1889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:41.413419 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "aaf80d532ce4486696f70e114f23584f"
format_stamp: "Formatted at 2026-08-11 00:54:41 on dist-test-slave-xt4k"
server_key: "1df8e8333bcbab8ee333b89135609e93"
server_key_iv: "9ad34454911fe105dbe982d58bc730ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:41.413743 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "aaf80d532ce4486696f70e114f23584f"
format_stamp: "Formatted at 2026-08-11 00:54:41 on dist-test-slave-xt4k"
server_key: "1df8e8333bcbab8ee333b89135609e93"
server_key_iv: "9ad34454911fe105dbe982d58bc730ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:41.415004 1889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:41.415699 1922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:41.415848 1889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:41.415943 1889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "aaf80d532ce4486696f70e114f23584f"
format_stamp: "Formatted at 2026-08-11 00:54:41 on dist-test-slave-xt4k"
server_key: "1df8e8333bcbab8ee333b89135609e93"
server_key_iv: "9ad34454911fe105dbe982d58bc730ef"
server_key_version: "encryptionkey@0"
I20260811 00:54:41.416009 1889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:41.434235 1889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:41.435986 1889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:41.436131 1889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:41.439901 1889 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:36391
I20260811 00:54:41.439961 2011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:36391 every 8 connection(s)
I20260811 00:54:41.440277 1889 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:41.441147 2016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:41.443436 2016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f: Bootstrap starting.
I20260811 00:54:41.443940 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 1889
I20260811 00:54:41.444060 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:41.444105 2016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:41.444247 27022 external_mini_cluster.cc:1428] Setting key 37d2c21911e181a4c91992bb1f4ab4b9
I20260811 00:54:41.444459 2016 log.cc:824] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:41.445218 2016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f: No bootstrap required, opened a new log
I20260811 00:54:41.447576 2016 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } }
I20260811 00:54:41.447754 2016 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:41.447791 2016 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaf80d532ce4486696f70e114f23584f, State: Initialized, Role: FOLLOWER
I20260811 00:54:41.447919 2016 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } }
I20260811 00:54:41.447995 2016 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:41.448017 2016 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:41.448061 2016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:41.448668 2016 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } }
I20260811 00:54:41.448776 2016 leader_election.cc:302] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaf80d532ce4486696f70e114f23584f; no voters:
I20260811 00:54:41.448931 2016 leader_election.cc:288] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:41.448972 2025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:41.449169 2025 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [term 1 LEADER]: Becoming Leader. State: Replica: aaf80d532ce4486696f70e114f23584f, State: Running, Role: LEADER
I20260811 00:54:41.449172 2016 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:41.449345 2025 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } }
I20260811 00:54:41.449785 2026 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaf80d532ce4486696f70e114f23584f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } } }
I20260811 00:54:41.449870 2026 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:41.450089 2029 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaf80d532ce4486696f70e114f23584f. Latest consensus state: current_term: 1 leader_uuid: "aaf80d532ce4486696f70e114f23584f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaf80d532ce4486696f70e114f23584f" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36391 } } }
I20260811 00:54:41.450094 2041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:41.450232 2029 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:41.450754 2041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[1863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:41.452766 2041 catalog_manager.cc:1347] Generated new cluster ID: 5f7666c08f09490c958791e247048a8a
I20260811 00:54:41.452818 2041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:41.455714 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:41.444825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46455 (local address 127.26.99.190:36391)
0811 00:54:41.444969 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:41.444979 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:41.445014 (+ 35us) server_negotiation.cc:407] Connection header received
0811 00:54:41.445585 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:41.445594 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:41.445655 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:41.445804 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:41.446375 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:41.447736 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:41.448591 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:41.449209 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:41.449337 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:41.452094 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:41.452098 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:41.452099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:41.452111 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:41.453890 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:41.454295 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:41.454298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:41.454298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:41.454389 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:41.454580 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:41.454580 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:41.454581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:41.454852 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:41.454981 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:41.455431 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 00:54:41.455525 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 00:54:41.456584 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:41.458753 2041 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:41.459380 2041 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:41.465021 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:41.458178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40329 (local address 127.26.99.190:36391)
0811 00:54:41.458209 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:41.458210 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:41.458219 (+ 9us) server_negotiation.cc:407] Connection header received
0811 00:54:41.458263 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:41.458264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:41.458272 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:41.458324 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:41.458952 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:41.459657 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:41.460656 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:41.460960 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:41.460994 (+ 34us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:41.462453 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:41.462455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:41.462455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:41.462462 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:41.463849 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:41.464215 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:41.464216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:41.464216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:41.464263 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:41.464483 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:41.464484 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:41.464484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:41.464607 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:41.464678 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:41.464876 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 00:54:41.464934 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 00:54:41.469256 2041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaf80d532ce4486696f70e114f23584f: Generated new TSK 0
I20260811 00:54:41.469427 2041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:41.473728 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 1889
W20260811 00:54:41.497495 1861 connection.cc:535] client connection to 127.26.99.190:36391 recv error: Network error: failed to read from TLS socket (remote: 127.26.99.190:36391): Connection reset by peer (error 104)
2026-08-11T00:54:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1468 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[2069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[2069](info): set up 2 sockets
Aug 11 00:54:41 dist-test-slave-xt4k krb5kdc[2069](info): commencing operation
krb5kdc: starting...
W20260811 00:54:42.662024 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:42 dist-test-slave-xt4k krb5kdc[2069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:42.774766 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40591
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:33411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:40591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:42.856392 2094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:42.856580 2094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:42.856609 2094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:42.857715 2094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:42.857757 2094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:42.857776 2094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:42.857792 2094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:42.857808 2094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:42.859318 2094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:33411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:40591
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:40591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:42.859552 2094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:42.859755 2094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:42.864389 2105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:42.864380 2115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:42.864377 2109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:42.864528 2094 server_base.cc:1034] running on GCE node
I20260811 00:54:42.864835 2094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:42.865095 2094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:42.866245 2094 hybrid_clock.cc:648] HybridClock initialized: now 1786409682866232 us; error 26 us; skew 500 ppm
Aug 11 00:54:42 dist-test-slave-xt4k krb5kdc[2069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409682, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:42.868572 2094 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:42.869028 2094 webserver.cc:460] Webserver started at http://127.26.99.190:35245/ using document root <none> and password file <none>
I20260811 00:54:42.869239 2094 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:42.869287 2094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:42.869410 2094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:42.870428 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "4b407b17e809489b96572a1822710674"
format_stamp: "Formatted at 2026-08-11 00:54:42 on dist-test-slave-xt4k"
server_key: "12e20d273a757ca5aa924be0b33546a8"
server_key_iv: "9f517d12fddb2b2b96ae32cf57cfc2f8"
server_key_version: "encryptionkey@0"
I20260811 00:54:42.870743 2094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "4b407b17e809489b96572a1822710674"
format_stamp: "Formatted at 2026-08-11 00:54:42 on dist-test-slave-xt4k"
server_key: "12e20d273a757ca5aa924be0b33546a8"
server_key_iv: "9f517d12fddb2b2b96ae32cf57cfc2f8"
server_key_version: "encryptionkey@0"
I20260811 00:54:42.871950 2094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:42.872730 2134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:42.872901 2094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:42.872987 2094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "4b407b17e809489b96572a1822710674"
format_stamp: "Formatted at 2026-08-11 00:54:42 on dist-test-slave-xt4k"
server_key: "12e20d273a757ca5aa924be0b33546a8"
server_key_iv: "9f517d12fddb2b2b96ae32cf57cfc2f8"
server_key_version: "encryptionkey@0"
I20260811 00:54:42.873045 2094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:42.890283 2094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:42.892364 2094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:42.892508 2094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:42.896296 2094 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:40591
I20260811 00:54:42.896399 2232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:40591 every 8 connection(s)
I20260811 00:54:42.896688 2094 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:42.897603 2234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:42.899398 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2094
I20260811 00:54:42.899530 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:42.899729 27022 external_mini_cluster.cc:1428] Setting key 38c8270d105f568f80b861ca991f6c82
I20260811 00:54:42.900147 2234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: Bootstrap starting.
I20260811 00:54:42.900776 2234 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:42.901036 2234 log.cc:824] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:42.901710 2234 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: No bootstrap required, opened a new log
I20260811 00:54:42.903803 2234 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } }
I20260811 00:54:42.903963 2234 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:42.904000 2234 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b407b17e809489b96572a1822710674, State: Initialized, Role: FOLLOWER
I20260811 00:54:42.904201 2234 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } }
I20260811 00:54:42.904286 2234 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:42.904309 2234 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:42.904366 2234 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:42.904892 2234 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } }
I20260811 00:54:42.904983 2234 leader_election.cc:302] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b407b17e809489b96572a1822710674; no voters:
I20260811 00:54:42.905164 2234 leader_election.cc:288] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:42.905306 2241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:42.905478 2234 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:42.905496 2239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:42.900260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43805 (local address 127.26.99.190:40591)
0811 00:54:42.900475 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:42.900483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:42.900508 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:54:42.900962 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:42.900969 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:42.901015 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:42.901127 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:42.901419 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:42.902373 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:42.903436 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:42.903842 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:42.903928 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:42.904720 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:42.904725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:42.904725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:42.904891 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:42.904922 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:42.904933 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:42.905014 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:42.905181 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 00:54:42.905213 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":95,"threads_started":1}
I20260811 00:54:42.905520 2241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [term 1 LEADER]: Becoming Leader. State: Replica: 4b407b17e809489b96572a1822710674, State: Running, Role: LEADER
I20260811 00:54:42.905905 2241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } }
I20260811 00:54:42.906504 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:42.906606 2242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b407b17e809489b96572a1822710674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } } }
I20260811 00:54:42.906702 2242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:42.906905 2244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b407b17e809489b96572a1822710674. Latest consensus state: current_term: 1 leader_uuid: "4b407b17e809489b96572a1822710674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b407b17e809489b96572a1822710674" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 40591 } } }
I20260811 00:54:42.906971 2244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674 [sys.catalog]: This master's current role is: LEADER
W20260811 00:54:42.907174 2265 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:42.907282 2265 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:42.907372 2266 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:42.907613 2266 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:42.909054 2266 catalog_manager.cc:1347] Generated new cluster ID: fab1234a06eb46c1adf0d461ca4d4801
I20260811 00:54:42.909104 2266 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:42.911316 2239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:42.908067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38333 (local address 127.26.99.190:40591)
0811 00:54:42.908098 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:42.908100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:42.908130 (+ 30us) server_negotiation.cc:407] Connection header received
0811 00:54:42.908148 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:42.908149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:42.908158 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:42.908199 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:42.908364 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:42.909059 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:42.910072 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:42.910385 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:42.910459 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:42.911078 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:42.911080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:42.911080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:42.911085 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:42.911102 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:42.911106 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:42.911164 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:42.911236 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 00:54:42.911247 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:54:42.915135 2266 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:42.915835 2266 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:42.922125 2266 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b407b17e809489b96572a1822710674: Generated new TSK 0
I20260811 00:54:42.922300 2266 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:42.925765 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2094
W20260811 00:54:42.955747 2065 connection.cc:535] client connection to 127.26.99.190:40591 recv error: Network error: failed to read from TLS socket (remote: 127.26.99.190:40591): Connection reset by peer (error 104)
2026-08-11T00:54:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:43 dist-test-slave-xt4k krb5kdc[2291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:43 dist-test-slave-xt4k krb5kdc[2291](info): set up 2 sockets
Aug 11 00:54:43 dist-test-slave-xt4k krb5kdc[2291](info): commencing operation
krb5kdc: starting...
W20260811 00:54:44.131146 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:44 dist-test-slave-xt4k krb5kdc[2291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:44.247189 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34771
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:42643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:34771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:44.327433 2316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:44.327633 2316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:44.327663 2316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:44.328814 2316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:44.328855 2316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:44.328874 2316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:44.328890 2316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:44.328905 2316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:44.330384 2316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:42643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:34771
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:34771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:44.330627 2316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:44.330826 2316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:44.335369 2329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:44.335371 2325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:44.335407 2326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:44.335399 2316 server_base.cc:1034] running on GCE node
I20260811 00:54:44.335786 2316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:44.336051 2316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:44.337200 2316 hybrid_clock.cc:648] HybridClock initialized: now 1786409684337179 us; error 36 us; skew 500 ppm
Aug 11 00:54:44 dist-test-slave-xt4k krb5kdc[2291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409684, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:44.339556 2316 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:44.339964 2316 webserver.cc:460] Webserver started at http://127.26.99.190:41177/ using document root <none> and password file <none>
I20260811 00:54:44.340147 2316 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:44.340185 2316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:44.340274 2316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:44.341272 2316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "56b9a80bf9404db0b1036d73f602d050"
format_stamp: "Formatted at 2026-08-11 00:54:44 on dist-test-slave-xt4k"
server_key: "0353faabed9b1e0ffad9145c1fe38f6a"
server_key_iv: "0bbe7273d2d535d21e0f369e9924e154"
server_key_version: "encryptionkey@0"
I20260811 00:54:44.341573 2316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "56b9a80bf9404db0b1036d73f602d050"
format_stamp: "Formatted at 2026-08-11 00:54:44 on dist-test-slave-xt4k"
server_key: "0353faabed9b1e0ffad9145c1fe38f6a"
server_key_iv: "0bbe7273d2d535d21e0f369e9924e154"
server_key_version: "encryptionkey@0"
I20260811 00:54:44.342761 2316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 00:54:44.343349 2340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:44.343511 2316 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 00:54:44.343605 2316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "56b9a80bf9404db0b1036d73f602d050"
format_stamp: "Formatted at 2026-08-11 00:54:44 on dist-test-slave-xt4k"
server_key: "0353faabed9b1e0ffad9145c1fe38f6a"
server_key_iv: "0bbe7273d2d535d21e0f369e9924e154"
server_key_version: "encryptionkey@0"
I20260811 00:54:44.343660 2316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:44.346756 2316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:44.348701 2316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:44.348802 2316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:44.352512 2316 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:34771
I20260811 00:54:44.352571 2449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:34771 every 8 connection(s)
I20260811 00:54:44.352845 2316 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:44.353734 2457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:44.355825 2457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050: Bootstrap starting.
I20260811 00:54:44.356323 2457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:44.356596 2457 log.cc:824] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:44.357204 2457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050: No bootstrap required, opened a new log
I20260811 00:54:44.358690 2457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } }
I20260811 00:54:44.358820 2457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:44.358841 2457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b9a80bf9404db0b1036d73f602d050, State: Initialized, Role: FOLLOWER
I20260811 00:54:44.358938 2457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } }
I20260811 00:54:44.358984 2457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:44.359009 2457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:44.359045 2457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:44.359769 2457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } }
I20260811 00:54:44.359853 2457 leader_election.cc:302] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56b9a80bf9404db0b1036d73f602d050; no voters:
I20260811 00:54:44.359974 2457 leader_election.cc:288] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:44.360016 2461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:44.360185 2457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:44.360203 2461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [term 1 LEADER]: Becoming Leader. State: Replica: 56b9a80bf9404db0b1036d73f602d050, State: Running, Role: LEADER
I20260811 00:54:44.360363 2461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } }
I20260811 00:54:44.360725 2463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56b9a80bf9404db0b1036d73f602d050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } } }
I20260811 00:54:44.360719 2467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56b9a80bf9404db0b1036d73f602d050. Latest consensus state: current_term: 1 leader_uuid: "56b9a80bf9404db0b1036d73f602d050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56b9a80bf9404db0b1036d73f602d050" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 34771 } } }
I20260811 00:54:44.360812 2463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:44.360818 2467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:44.361050 2480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:44.361584 2480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:44.361689 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2316
I20260811 00:54:44.361799 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:44.361980 27022 external_mini_cluster.cc:1428] Setting key 2979d081c7b13425d0f33e7635c9a540
I20260811 00:54:44.363210 2480 catalog_manager.cc:1347] Generated new cluster ID: af763359b5b6428c93969f2db84735c7
I20260811 00:54:44.363260 2480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:44.363961 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:44.362357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33837 (local address 127.26.99.190:34771)
0811 00:54:44.362527 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:44.362535 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:44.362723 (+ 188us) server_negotiation.cc:407] Connection header received
0811 00:54:44.362856 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:44.362867 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:44.362896 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:44.363020 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:44.363583 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:44.363587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:44.363588 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:44.363591 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:44.363626 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:44.363637 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:44.363687 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:44.363752 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 00:54:44.363792 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260811 00:54:44.364841 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:44.370878 2499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:44.368622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35037 (local address 127.26.99.190:34771)
0811 00:54:44.368659 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:44.368661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:44.370082 (+ 1421us) server_negotiation.cc:407] Connection header received
0811 00:54:44.370137 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:44.370137 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:44.370143 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:44.370195 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:44.370692 (+ 497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:44.370693 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:44.370693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:44.370698 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:44.370711 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:44.370715 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:44.370760 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:44.370810 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 00:54:44.370822 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:54:44.371682 2480 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:44.371827 2480 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:44.386655 2480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56b9a80bf9404db0b1036d73f602d050: Generated new TSK 0
I20260811 00:54:44.386840 2480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:44.391170 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2316
2026-08-11T00:54:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:44 dist-test-slave-xt4k krb5kdc[2512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:44 dist-test-slave-xt4k krb5kdc[2512](info): set up 2 sockets
Aug 11 00:54:44 dist-test-slave-xt4k krb5kdc[2512](info): commencing operation
krb5kdc: starting...
W20260811 00:54:45.586341 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:45.699200 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:36993
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:37053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:36993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:45.780050 2539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:45.780252 2539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:45.780282 2539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:45.781467 2539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:45.781510 2539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:45.781529 2539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:45.781545 2539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:45.781560 2539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:45.783072 2539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:36993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:36993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:45.783315 2539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:45.783528 2539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:45.788045 2554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:45.788055 2563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:45.788055 2555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:45.788298 2539 server_base.cc:1034] running on GCE node
I20260811 00:54:45.788533 2539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:45.788805 2539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:45.789940 2539 hybrid_clock.cc:648] HybridClock initialized: now 1786409685789929 us; error 30 us; skew 500 ppm
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409685, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:45.796204 2539 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:45.796659 2539 webserver.cc:460] Webserver started at http://127.26.99.190:43343/ using document root <none> and password file <none>
I20260811 00:54:45.796883 2539 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:45.796931 2539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:45.797053 2539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:45.798084 2539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "10d8ca5f77d94da495e1655578c2c9c3"
format_stamp: "Formatted at 2026-08-11 00:54:45 on dist-test-slave-xt4k"
server_key: "85c6a8427b53b3ded6dd04db60292689"
server_key_iv: "4e7da7d7997224589e5ae3e645499c43"
server_key_version: "encryptionkey@0"
I20260811 00:54:45.798408 2539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "10d8ca5f77d94da495e1655578c2c9c3"
format_stamp: "Formatted at 2026-08-11 00:54:45 on dist-test-slave-xt4k"
server_key: "85c6a8427b53b3ded6dd04db60292689"
server_key_iv: "4e7da7d7997224589e5ae3e645499c43"
server_key_version: "encryptionkey@0"
I20260811 00:54:45.799654 2539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 00:54:45.800411 2576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:45.800559 2539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:45.800647 2539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "10d8ca5f77d94da495e1655578c2c9c3"
format_stamp: "Formatted at 2026-08-11 00:54:45 on dist-test-slave-xt4k"
server_key: "85c6a8427b53b3ded6dd04db60292689"
server_key_iv: "4e7da7d7997224589e5ae3e645499c43"
server_key_version: "encryptionkey@0"
I20260811 00:54:45.800714 2539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:45.823427 2539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:45.825316 2539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:45.825450 2539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:45.829133 2539 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:36993
I20260811 00:54:45.829171 2683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:36993 every 8 connection(s)
I20260811 00:54:45.829484 2539 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:45.830296 2686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:45.832504 2686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3: Bootstrap starting.
I20260811 00:54:45.833030 2686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:45.833257 2686 log.cc:824] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:45.833873 2686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3: No bootstrap required, opened a new log
I20260811 00:54:45.834069 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2539
I20260811 00:54:45.834184 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:45.834338 27022 external_mini_cluster.cc:1428] Setting key afec8268517999f4fcf72ef14a030ca3
I20260811 00:54:45.835878 2686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } }
I20260811 00:54:45.836068 2686 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:45.836114 2686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d8ca5f77d94da495e1655578c2c9c3, State: Initialized, Role: FOLLOWER
I20260811 00:54:45.836238 2686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } }
I20260811 00:54:45.836318 2686 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:45.836417 2686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:45.836475 2686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:45.836980 2686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } }
I20260811 00:54:45.837080 2686 leader_election.cc:302] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d8ca5f77d94da495e1655578c2c9c3; no voters:
I20260811 00:54:45.837208 2686 leader_election.cc:288] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:45.837256 2698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:45.837432 2698 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [term 1 LEADER]: Becoming Leader. State: Replica: 10d8ca5f77d94da495e1655578c2c9c3, State: Running, Role: LEADER
I20260811 00:54:45.837460 2686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:45.837519 2698 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } }
I20260811 00:54:45.837901 2698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d8ca5f77d94da495e1655578c2c9c3. Latest consensus state: current_term: 1 leader_uuid: "10d8ca5f77d94da495e1655578c2c9c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } } }
I20260811 00:54:45.837999 2698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:45.838121 2699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d8ca5f77d94da495e1655578c2c9c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8ca5f77d94da495e1655578c2c9c3" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 36993 } } }
I20260811 00:54:45.838184 2699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:45.838289 2714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:45.838822 2714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:45.840422 2714 catalog_manager.cc:1347] Generated new cluster ID: a7bc8a3f92794343b157d3d90fa3064f
I20260811 00:54:45.840469 2714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:45.845438 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:45.834795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42065 (local address 127.26.99.190:36993)
0811 00:54:45.834976 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:45.834983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:45.835008 (+ 25us) server_negotiation.cc:407] Connection header received
0811 00:54:45.835479 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:45.835485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:45.835529 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:45.835642 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:45.836438 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:45.837968 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:45.839862 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:45.840304 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:45.840472 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:45.842571 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:45.842576 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:45.842576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:45.842587 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:45.844028 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:45.844354 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:45.844358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:45.844358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:45.844447 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:45.844626 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:45.844627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:45.844627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:45.844841 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:45.844992 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:45.845069 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 00:54:45.845292 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260811 00:54:45.846235 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:45.857301 2714 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:45.858001 2714 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:45.858103 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:45.852612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50907 (local address 127.26.99.190:36993)
0811 00:54:45.852655 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:45.852657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:45.852826 (+ 169us) server_negotiation.cc:407] Connection header received
0811 00:54:45.852876 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:45.852877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:45.852886 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:45.852929 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:45.853391 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:45.853837 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:45.854475 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:45.854682 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:45.854736 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:45.855747 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:45.855748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:45.855748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:45.855755 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:45.856963 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:45.857358 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:45.857359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:45.857360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:45.857416 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:45.857607 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:45.857608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:45.857609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:45.857721 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:45.857806 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:45.857929 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 00:54:45.858002 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:54:45.861232 2714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d8ca5f77d94da495e1655578c2c9c3: Generated new TSK 0
I20260811 00:54:45.861387 2714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:45.865247 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2539
2026-08-11T00:54:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1474 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2751](info): set up 2 sockets
Aug 11 00:54:45 dist-test-slave-xt4k krb5kdc[2751](info): commencing operation
krb5kdc: starting...
W20260811 00:54:47.053548 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:47 dist-test-slave-xt4k krb5kdc[2751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:47.170737 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37887
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:41859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:37887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:47.251902 2769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:47.252096 2769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:47.252117 2769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:47.253217 2769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:47.253252 2769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:47.253264 2769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:47.253275 2769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:47.253286 2769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:47.254688 2769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:41859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:37887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:37887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:47.254870 2769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:47.255038 2769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:47.259620 2790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:47.259660 2769 server_base.cc:1034] running on GCE node
W20260811 00:54:47.259637 2779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:47.259627 2775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:47.260046 2769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:47.260308 2769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:47.261478 2769 hybrid_clock.cc:648] HybridClock initialized: now 1786409687261465 us; error 28 us; skew 500 ppm
Aug 11 00:54:47 dist-test-slave-xt4k krb5kdc[2751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409687, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:47.263854 2769 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:47.264278 2769 webserver.cc:460] Webserver started at http://127.26.99.190:43185/ using document root <none> and password file <none>
I20260811 00:54:47.264518 2769 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:47.264564 2769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:47.264676 2769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:47.265686 2769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "0851ab3c06a440dcb528419a14b90fcd"
format_stamp: "Formatted at 2026-08-11 00:54:47 on dist-test-slave-xt4k"
server_key: "d4a57feb35083a031f0e7e4d6c3acc03"
server_key_iv: "1e2e6cfc1b5a1a45da21762de034d78b"
server_key_version: "encryptionkey@0"
I20260811 00:54:47.266008 2769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "0851ab3c06a440dcb528419a14b90fcd"
format_stamp: "Formatted at 2026-08-11 00:54:47 on dist-test-slave-xt4k"
server_key: "d4a57feb35083a031f0e7e4d6c3acc03"
server_key_iv: "1e2e6cfc1b5a1a45da21762de034d78b"
server_key_version: "encryptionkey@0"
I20260811 00:54:47.267234 2769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:54:47.267890 2802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:47.268043 2769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:47.268115 2769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "0851ab3c06a440dcb528419a14b90fcd"
format_stamp: "Formatted at 2026-08-11 00:54:47 on dist-test-slave-xt4k"
server_key: "d4a57feb35083a031f0e7e4d6c3acc03"
server_key_iv: "1e2e6cfc1b5a1a45da21762de034d78b"
server_key_version: "encryptionkey@0"
I20260811 00:54:47.268175 2769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:47.284868 2769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:47.286646 2769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:47.286777 2769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:47.290691 2769 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:37887
I20260811 00:54:47.290743 2907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:37887 every 8 connection(s)
I20260811 00:54:47.291075 2769 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:47.291920 2908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:47.294239 2908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd: Bootstrap starting.
I20260811 00:54:47.294787 2908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:47.295056 2908 log.cc:824] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:47.295297 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2769
I20260811 00:54:47.295403 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:47.295594 27022 external_mini_cluster.cc:1428] Setting key fe8f55c11f221029352454674610e629
I20260811 00:54:47.295815 2908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd: No bootstrap required, opened a new log
I20260811 00:54:47.298254 2908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } }
I20260811 00:54:47.298389 2908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:47.298424 2908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0851ab3c06a440dcb528419a14b90fcd, State: Initialized, Role: FOLLOWER
I20260811 00:54:47.298547 2908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } }
I20260811 00:54:47.298624 2908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:47.298657 2908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:47.298699 2908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:47.299352 2908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } }
I20260811 00:54:47.299453 2908 leader_election.cc:302] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0851ab3c06a440dcb528419a14b90fcd; no voters:
I20260811 00:54:47.299598 2908 leader_election.cc:288] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:47.299633 2917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:47.299793 2917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [term 1 LEADER]: Becoming Leader. State: Replica: 0851ab3c06a440dcb528419a14b90fcd, State: Running, Role: LEADER
I20260811 00:54:47.299857 2908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:47.299968 2917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } }
I20260811 00:54:47.300364 2917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0851ab3c06a440dcb528419a14b90fcd. Latest consensus state: current_term: 1 leader_uuid: "0851ab3c06a440dcb528419a14b90fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } } }
I20260811 00:54:47.300490 2917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:47.300426 2920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0851ab3c06a440dcb528419a14b90fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0851ab3c06a440dcb528419a14b90fcd" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 37887 } } }
I20260811 00:54:47.300740 2920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:47.300740 2932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:47.301301 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:47.296087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35173 (local address 127.26.99.190:37887)
0811 00:54:47.296259 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:47.296268 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:47.296297 (+ 29us) server_negotiation.cc:407] Connection header received
0811 00:54:47.297081 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:47.297088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:47.297138 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:47.297248 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:47.297473 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:47.298327 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:47.299349 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:47.299900 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:47.300005 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:47.300636 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:47.300640 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:47.300640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:47.300836 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:47.300876 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:47.300891 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:47.300948 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:47.301045 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 00:54:47.301106 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":74,"threads_started":1}
I20260811 00:54:47.301335 2932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:47.302343 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:47.302969 2932 catalog_manager.cc:1347] Generated new cluster ID: cfcf12ca16a543cc828a6d51c717ac0c
I20260811 00:54:47.303025 2932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:47.306325 2916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:47.303862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51099 (local address 127.26.99.190:37887)
0811 00:54:47.303894 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:47.303895 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:47.303964 (+ 69us) server_negotiation.cc:407] Connection header received
0811 00:54:47.304017 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:47.304018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:47.304027 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:47.304074 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:47.304187 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:47.304689 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:47.305347 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:47.305554 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:47.305606 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:47.306131 (+ 525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:47.306132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:47.306133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:47.306137 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:47.306150 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:47.306154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:47.306196 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:47.306239 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 00:54:47.306258 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 00:54:47.318518 2932 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:47.319037 2932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:47.324244 2932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0851ab3c06a440dcb528419a14b90fcd: Generated new TSK 0
I20260811 00:54:47.324448 2932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:47.328080 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2769
2026-08-11T00:54:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1469 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:47 dist-test-slave-xt4k krb5kdc[2965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:47 dist-test-slave-xt4k krb5kdc[2965](info): set up 2 sockets
Aug 11 00:54:47 dist-test-slave-xt4k krb5kdc[2965](info): commencing operation
krb5kdc: starting...
W20260811 00:54:48.521474 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:48 dist-test-slave-xt4k krb5kdc[2965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:48.636970 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38871
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:38613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:38871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:48.718184 2985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:48.718389 2985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:48.718418 2985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:48.719529 2985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:48.719569 2985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:48.719588 2985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:48.719604 2985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:48.719621 2985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:48.721145 2985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:38613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:38871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:38871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:48.721381 2985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:48.721587 2985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:48.726260 2994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:48.726294 3003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:48.726307 2985 server_base.cc:1034] running on GCE node
W20260811 00:54:48.726274 2993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:48.726763 2985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:48.727028 2985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:48.728170 2985 hybrid_clock.cc:648] HybridClock initialized: now 1786409688728159 us; error 27 us; skew 500 ppm
Aug 11 00:54:48 dist-test-slave-xt4k krb5kdc[2965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409688, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:48.730495 2985 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:48.730891 2985 webserver.cc:460] Webserver started at http://127.26.99.190:39253/ using document root <none> and password file <none>
I20260811 00:54:48.731092 2985 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:48.731137 2985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:48.731256 2985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:48.732331 2985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "2237f8b1885d4f6dbad1f6e427088e87"
format_stamp: "Formatted at 2026-08-11 00:54:48 on dist-test-slave-xt4k"
server_key: "bec5cd4ddc4d7c6e5fdc72f04d48974b"
server_key_iv: "4ec3ff16ca32c89d0460cd214c0a03bf"
server_key_version: "encryptionkey@0"
I20260811 00:54:48.732718 2985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "2237f8b1885d4f6dbad1f6e427088e87"
format_stamp: "Formatted at 2026-08-11 00:54:48 on dist-test-slave-xt4k"
server_key: "bec5cd4ddc4d7c6e5fdc72f04d48974b"
server_key_iv: "4ec3ff16ca32c89d0460cd214c0a03bf"
server_key_version: "encryptionkey@0"
I20260811 00:54:48.734046 2985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:48.734678 3015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:48.734851 2985 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:48.734942 2985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "2237f8b1885d4f6dbad1f6e427088e87"
format_stamp: "Formatted at 2026-08-11 00:54:48 on dist-test-slave-xt4k"
server_key: "bec5cd4ddc4d7c6e5fdc72f04d48974b"
server_key_iv: "4ec3ff16ca32c89d0460cd214c0a03bf"
server_key_version: "encryptionkey@0"
I20260811 00:54:48.735000 2985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:48.738260 2985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:48.740074 2985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:48.740175 2985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:48.744484 2985 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:38871
I20260811 00:54:48.744760 3120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:38871 every 8 connection(s)
I20260811 00:54:48.744887 2985 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:48.745697 3121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:48.748905 3121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87: Bootstrap starting.
I20260811 00:54:48.749782 3121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:48.750205 3121 log.cc:824] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:48.751946 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 2985
I20260811 00:54:48.752045 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:48.752209 27022 external_mini_cluster.cc:1428] Setting key 94efe767f667564475f658da6762bd61
I20260811 00:54:48.752996 3121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87: No bootstrap required, opened a new log
I20260811 00:54:48.755245 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:48.752674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45993 (local address 127.26.99.190:38871)
0811 00:54:48.752869 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:48.752880 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:48.752918 (+ 38us) server_negotiation.cc:407] Connection header received
0811 00:54:48.753550 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:48.753561 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:48.753596 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:48.753745 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:48.754520 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:48.754524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:48.754524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:48.754529 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:48.754574 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:48.754596 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:48.754686 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:48.754750 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 00:54:48.754791 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260811 00:54:48.755221 3121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } }
I20260811 00:54:48.755380 3121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 00:54:48.755409 3121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2237f8b1885d4f6dbad1f6e427088e87, State: Initialized, Role: FOLLOWER
I20260811 00:54:48.755525 3121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } }
I20260811 00:54:48.755604 3121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 00:54:48.755666 3121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 00:54:48.755716 3121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:48.756248 3121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } }
I20260811 00:54:48.756381 3121 leader_election.cc:302] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2237f8b1885d4f6dbad1f6e427088e87; no voters:
I20260811 00:54:48.756538 3121 leader_election.cc:288] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 00:54:48.756577 3130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:48.756641 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:48.756707 3130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [term 1 LEADER]: Becoming Leader. State: Replica: 2237f8b1885d4f6dbad1f6e427088e87, State: Running, Role: LEADER
I20260811 00:54:48.756764 3121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:48.756820 3130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } }
I20260811 00:54:48.757164 3130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2237f8b1885d4f6dbad1f6e427088e87. Latest consensus state: current_term: 1 leader_uuid: "2237f8b1885d4f6dbad1f6e427088e87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } } }
I20260811 00:54:48.757370 3130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:48.757303 3132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2237f8b1885d4f6dbad1f6e427088e87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2237f8b1885d4f6dbad1f6e427088e87" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 38871 } } }
I20260811 00:54:48.757608 3132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:48.757962 3150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:48.758514 3150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:48.759991 3150 catalog_manager.cc:1347] Generated new cluster ID: 28173316cead45ff8380ed61d631f416
I20260811 00:54:48.760038 3150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:48.760118 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:48.758629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59933 (local address 127.26.99.190:38871)
0811 00:54:48.758666 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:48.758668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:48.758925 (+ 257us) server_negotiation.cc:407] Connection header received
0811 00:54:48.758984 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:48.758985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:48.759000 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:48.759055 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:48.759815 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:48.759817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:48.759817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 00:54:48.759822 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:48.759837 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 00:54:48.759841 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:48.759901 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:48.760050 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 00:54:48.760063 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:48.771644 3150 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:48.771809 3150 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:48.784669 3150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2237f8b1885d4f6dbad1f6e427088e87: Generated new TSK 0
I20260811 00:54:48.784883 3150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:48.789548 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 2985
2026-08-11T00:54:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1455 ms)
[----------] 18 tests from AuthTokenIssuingTest (26413 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:48 dist-test-slave-xt4k krb5kdc[3180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:48 dist-test-slave-xt4k krb5kdc[3180](info): set up 2 sockets
Aug 11 00:54:48 dist-test-slave-xt4k krb5kdc[3180](info): commencing operation
krb5kdc: starting...
W20260811 00:54:49.997315 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:50.113348 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:41681
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:50.195302 3207 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:50.195501 3207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:50.195518 3207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:50.195536 3207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:50.196671 3207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:50.196712 3207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:50.196725 3207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:50.196736 3207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:50.196748 3207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:50.198227 3207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:41681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:50.198473 3207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:50.198678 3207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:50.203204 3216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.203222 3222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.203198 3220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:50.203612 3207 server_base.cc:1034] running on GCE node
I20260811 00:54:50.203823 3207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:50.204103 3207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:50.205252 3207 hybrid_clock.cc:648] HybridClock initialized: now 1786409690205234 us; error 33 us; skew 500 ppm
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:50.207616 3207 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:50.208048 3207 webserver.cc:460] Webserver started at http://127.26.99.190:46245/ using document root <none> and password file <none>
I20260811 00:54:50.208268 3207 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:50.208314 3207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:50.208446 3207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:50.209417 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "7027894db70a4479b26113a4bf3f2c24"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "f9eb8b9cde73291e551b40f7d9c35747"
server_key_iv: "4dae338760978e30e70b237dc2f1acb7"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.209702 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "7027894db70a4479b26113a4bf3f2c24"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "f9eb8b9cde73291e551b40f7d9c35747"
server_key_iv: "4dae338760978e30e70b237dc2f1acb7"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.210901 3207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:50.211548 3247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:50.211706 3207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:50.211792 3207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "7027894db70a4479b26113a4bf3f2c24"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "f9eb8b9cde73291e551b40f7d9c35747"
server_key_iv: "4dae338760978e30e70b237dc2f1acb7"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.211848 3207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:50.220623 3207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:50.222314 3207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:50.222430 3207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:50.226087 3207 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:41681
I20260811 00:54:50.226137 3335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:41681 every 8 connection(s)
I20260811 00:54:50.226434 3207 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:50.227370 3336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:50.228770 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3207
I20260811 00:54:50.228855 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:50.229009 27022 external_mini_cluster.cc:1428] Setting key d3c1a1b6f45903347f316addf3e97d6d
I20260811 00:54:50.228935 3336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.99.189@KRBTEST.COM; defaulting to no policy
I20260811 00:54:50.238126 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.229630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:41681 (local address 127.0.0.1:33918)
0811 00:54:50.229799 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.229836 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.230295 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.230555 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.230558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.230819 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.230965 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.230970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.231937 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.231938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.232663 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.232665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.233135 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.233136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.233200 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.233634 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.233643 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.234921 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.236857 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.236864 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.236865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.237082 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.237300 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.237300 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.237300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.237373 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.237659 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.237666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.237727 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.237821 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.238023 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":59,"thread_start_us":94,"threads_started":1}
I20260811 00:54:50.238126 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.229646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33918 (local address 127.26.99.190:41681)
0811 00:54:50.229802 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.229811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.229924 (+ 113us) server_negotiation.cc:407] Connection header received
0811 00:54:50.230439 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.230442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.230460 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.230535 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.231055 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.231851 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.232734 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.233039 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.233136 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.235009 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.235025 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.235025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.235032 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.236764 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.237155 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.237158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.237159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.237245 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.237409 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.237409 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.237409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.237597 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.237653 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.237853 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.237946 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
I20260811 00:54:50.238869 3336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:50.239190 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.239072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33082)
0811 00:54:50.239111 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.239174 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 00:54:50.239354 3260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.189@KRBTEST.COM" created.
I20260811 00:54:50.239766 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.239672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33088)
0811 00:54:50.239720 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.239746 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 00:54:50.239861 3336 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:34215: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
I20260811 00:54:50.252327 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:34215
--webserver_interface=127.26.99.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:54:50.289029 3336 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } attempt: 1
I20260811 00:54:50.289537 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.289409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33098)
0811 00:54:50.289468 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.289498 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 00:54:50.289861 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.289752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33114)
0811 00:54:50.289807 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.289834 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 00:54:50.290027 3336 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:34215: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
W20260811 00:54:50.338358 3360 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:50.338581 3360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:50.338599 3360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:50.338618 3360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:50.339718 3360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:50.339753 3360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:50.339766 3360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:50.339777 3360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:50.339787 3360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:50.341445 3360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:34215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.99.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:50.341666 3360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:50.341859 3360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:50.346582 3371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.346596 3368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.346647 3374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:50.346629 3360 server_base.cc:1034] running on GCE node
I20260811 00:54:50.346939 3360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:50.347227 3360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:50.348410 3360 hybrid_clock.cc:648] HybridClock initialized: now 1786409690348394 us; error 30 us; skew 500 ppm
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:50.351015 3360 init.cc:377] Logged in from keytab as kudu/127.26.99.189@KRBTEST.COM (short username kudu)
I20260811 00:54:50.351432 3360 webserver.cc:460] Webserver started at http://127.26.99.189:33119/ using document root <none> and password file <none>
I20260811 00:54:50.351643 3360 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:50.351692 3360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:50.351811 3360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:50.352895 3360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data/instance:
uuid: "b6d35e7ca2324c4fb15350736c83e098"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "b465526375f65ca1fbd078d99c1fd9c8"
server_key_iv: "27845b38b329539241bc624df0ea3ac4"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.353226 3360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal/instance:
uuid: "b6d35e7ca2324c4fb15350736c83e098"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "b465526375f65ca1fbd078d99c1fd9c8"
server_key_iv: "27845b38b329539241bc624df0ea3ac4"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.354461 3360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:50.355129 3392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:50.355274 3360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:50.355366 3360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "b6d35e7ca2324c4fb15350736c83e098"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "b465526375f65ca1fbd078d99c1fd9c8"
server_key_iv: "27845b38b329539241bc624df0ea3ac4"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.355427 3360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:50.358180 3336 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } attempt: 2
I20260811 00:54:50.358546 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.358427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33122)
0811 00:54:50.358478 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.358513 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:54:50.358873 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.358781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33136)
0811 00:54:50.358820 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.358847 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 00:54:50.358965 3336 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:34215: Network error: Client connection negotiation failed: client connection to 127.26.99.189:34215: connect: Connection refused (error 111)
I20260811 00:54:50.362967 3360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:50.364879 3360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:50.364987 3360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:50.368878 3360 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.189:34215
I20260811 00:54:50.368927 3488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.189:34215 every 8 connection(s)
I20260811 00:54:50.369223 3360 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
I20260811 00:54:50.370150 3489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:50.371615 3489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:50.377110 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3360
I20260811 00:54:50.377189 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-1/wal/instance
I20260811 00:54:50.377364 27022 external_mini_cluster.cc:1428] Setting key 9e4f78495fdc768bd1fa52f3b635f3e2
I20260811 00:54:50.379818 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.372241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33920 (local address 127.26.99.190:41681)
0811 00:54:50.372317 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.372319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.372526 (+ 207us) server_negotiation.cc:407] Connection header received
0811 00:54:50.372960 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.372961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.372971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.373023 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.373595 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.374064 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.375031 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.375229 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.375281 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.377292 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.377294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.377294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.377302 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.378595 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.378938 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.378939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.378940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.379000 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.379262 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.379263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.379263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.379362 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.379410 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.379694 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.379756 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:54:50.380041 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.372207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:41681 (local address 127.0.0.1:33920)
0811 00:54:50.372383 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.372437 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.372883 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.373089 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.373092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.373325 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.373531 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.373536 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.374159 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.374161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.374950 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.374952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.375303 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.375303 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.375393 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.375844 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.375852 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.377207 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.378665 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.378672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.378674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.378875 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.379061 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.379063 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.379063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.379200 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.379413 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.379418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.379571 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.379672 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.379823 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260811 00:54:50.380621 3489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.99.188@KRBTEST.COM; defaulting to no policy
I20260811 00:54:50.387466 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.380846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33150)
0811 00:54:50.380891 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.380903 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.380946 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.381160 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.381160 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.381293 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.381345 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.381347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.382214 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.382215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.382985 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.382988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.383399 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.383400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.383474 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.383784 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.383789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.385001 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.386573 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.386574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.386574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.386720 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.386887 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.386888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.386888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.386947 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.387178 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.387179 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.387215 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.387275 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.387370 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 00:54:50.387537 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.380901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33150 (local address 127.26.99.189:34215)
0811 00:54:50.381037 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.381041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.381060 (+ 19us) server_negotiation.cc:407] Connection header received
0811 00:54:50.381078 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.381080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.381090 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.381144 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.381414 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.382126 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.383058 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.383335 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.383380 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.385080 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.385087 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.385087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.385094 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.386502 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.386783 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.386786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.386787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.386834 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.386996 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.386997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.386997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.387120 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.387187 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.387316 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.387426 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260811 00:54:50.388074 3489 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:50.388397 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.388258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43284)
0811 00:54:50.388305 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.388371 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.188@KRBTEST.COM" created.
W20260811 00:54:50.388535 3395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
I20260811 00:54:50.388908 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.388845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43290)
0811 00:54:50.388869 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.388892 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 00:54:50.389029 3489 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:46197: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
I20260811 00:54:50.403060 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:46197
--webserver_interface=127.26.99.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:37937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:54:50.438239 3489 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } attempt: 1
I20260811 00:54:50.438725 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.438602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43306)
0811 00:54:50.438661 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.438692 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 00:54:50.439106 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.438954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43314)
0811 00:54:50.439021 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.439070 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 00:54:50.439222 3489 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:46197: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
I20260811 00:54:50.450107 3336 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } attempt: 3
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:54:50.457360 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.450482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33156)
0811 00:54:50.450573 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.450586 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.450648 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.450814 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.450816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.450985 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.451059 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.451061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.452021 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.452022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.452606 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.452609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.453083 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.453085 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.453155 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.453608 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.453613 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.454779 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.456461 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.456462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.456462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.456632 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.456820 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.456820 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.456821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.456865 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.457105 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.457106 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.457150 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.457199 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.457274 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 00:54:50.457401 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.450567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33156 (local address 127.26.99.189:34215)
0811 00:54:50.450637 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.450639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.450653 (+ 14us) server_negotiation.cc:407] Connection header received
0811 00:54:50.450703 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.450704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.450718 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.450780 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.451129 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.451934 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.452672 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.453005 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.453076 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.454864 (+ 1788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.454866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.454867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.454875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.456377 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.456697 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.456698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.456698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.456758 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.456911 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.456912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.456912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.457045 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.457114 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.457232 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.457308 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 00:54:50.457865 3336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:50.458199 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.458110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43328)
0811 00:54:50.458143 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.458171 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 00:54:50.458498 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.458424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43344)
0811 00:54:50.458453 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.458476 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 00:54:50.458586 3336 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:46197: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
W20260811 00:54:50.486388 3504 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:50.486603 3504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:50.486627 3504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:50.486651 3504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:50.487782 3504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:50.487824 3504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:50.487843 3504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:50.487859 3504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:50.487874 3504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:50.489377 3504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:37937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:41681,127.26.99.189:34215,127.26.99.188:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:46197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.99.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:50.489622 3504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:50.489730 3336 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } attempt: 1
I20260811 00:54:50.489835 3504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 00:54:50.490118 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.490003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43354)
0811 00:54:50.490057 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.490089 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 00:54:50.490442 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.490357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43362)
0811 00:54:50.490399 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.490423 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 00:54:50.490531 3336 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:46197: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
W20260811 00:54:50.494558 3516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.494571 3512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:50.494577 3518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:50.494808 3504 server_base.cc:1034] running on GCE node
I20260811 00:54:50.494995 3504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:50.495239 3504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:50.496400 3504 hybrid_clock.cc:648] HybridClock initialized: now 1786409690496386 us; error 26 us; skew 500 ppm
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:50.498831 3504 init.cc:377] Logged in from keytab as kudu/127.26.99.188@KRBTEST.COM (short username kudu)
I20260811 00:54:50.499238 3504 webserver.cc:460] Webserver started at http://127.26.99.188:39055/ using document root <none> and password file <none>
I20260811 00:54:50.499444 3504 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:50.499490 3504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:50.499614 3504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:50.500653 3504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data/instance:
uuid: "8fc0ede57dd3452495aa6c416235343f"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "26f0b10c5152829c0bc9ba3b4ee30df4"
server_key_iv: "f21812b8520f8de47a1b183f78afdf42"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.500969 3504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal/instance:
uuid: "8fc0ede57dd3452495aa6c416235343f"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "26f0b10c5152829c0bc9ba3b4ee30df4"
server_key_iv: "f21812b8520f8de47a1b183f78afdf42"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.502219 3504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:50.502897 3531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:50.503057 3504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 00:54:50.503141 3504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "8fc0ede57dd3452495aa6c416235343f"
format_stamp: "Formatted at 2026-08-11 00:54:50 on dist-test-slave-xt4k"
server_key: "26f0b10c5152829c0bc9ba3b4ee30df4"
server_key_iv: "f21812b8520f8de47a1b183f78afdf42"
server_key_version: "encryptionkey@0"
I20260811 00:54:50.503201 3504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:50.507361 3489 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } attempt: 2
I20260811 00:54:50.507781 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.507601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43368)
0811 00:54:50.507650 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.507682 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:54:50.508143 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.508050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43376)
0811 00:54:50.508100 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.508125 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 00:54:50.508224 3489 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:46197: Network error: Client connection negotiation failed: client connection to 127.26.99.188:46197: connect: Connection refused (error 111)
I20260811 00:54:50.528052 3504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:50.530198 3504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:50.530339 3504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:50.534399 3504 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.188:46197
I20260811 00:54:50.534426 3629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.188:46197 every 8 connection(s)
I20260811 00:54:50.534776 3504 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
I20260811 00:54:50.535724 3634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:50.537262 3634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:50.538149 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3504
I20260811 00:54:50.538244 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786409417711920-27022-0/minicluster-data/master-2/wal/instance
I20260811 00:54:50.538419 27022 external_mini_cluster.cc:1428] Setting key 0cda9b267b78a8b621e3901164c927de
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:50.546705 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.537912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33936 (local address 127.26.99.190:41681)
0811 00:54:50.537965 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.537967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.538169 (+ 202us) server_negotiation.cc:407] Connection header received
0811 00:54:50.538723 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.538725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.538738 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.538792 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.539677 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.540447 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.541534 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.541730 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.541801 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.544022 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.544023 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.544023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.544031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.545426 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.545852 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.545853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.545853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.545906 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.546110 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.546111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.546112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.546222 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.546277 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.546532 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.546614 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 00:54:50.546929 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.538755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43388 (local address 127.26.99.188:46197)
0811 00:54:50.538908 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.538914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.538951 (+ 37us) server_negotiation.cc:407] Connection header received
0811 00:54:50.539025 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.539026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.539046 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.539107 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.539769 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.540823 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.541720 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.542053 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.542116 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.544429 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.544437 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.544437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.544444 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.545824 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.546127 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.546129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.546130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.546181 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.546343 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.546344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.546344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.546471 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.546593 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.546673 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.546749 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260811 00:54:50.546965 3636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.537868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:41681 (local address 127.0.0.1:33936)
0811 00:54:50.538053 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.538093 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.538616 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.538977 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.538981 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.539317 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.539578 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.539584 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.540525 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.540525 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.541447 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.541449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.541822 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.541823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.541920 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.542389 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.542399 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.543926 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.545502 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.545508 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.545511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.545788 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.545960 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.545961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.545961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.546055 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.546277 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.546284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.546409 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.546501 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.546647 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260811 00:54:50.547607 3634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:50.553498 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.547908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33170 (local address 127.26.99.189:34215)
0811 00:54:50.547960 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.547962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.547969 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:50.547991 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.547992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.548001 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.548045 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.548278 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.548781 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.549385 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.549596 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.549653 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.551288 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.551289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.551290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.551295 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.552562 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.552882 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.552883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.552884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.552939 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.553091 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.553092 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.553092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.553214 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.553281 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.553365 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.553432 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 00:54:50.553501 3636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.547838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:34215 (local address 127.0.0.1:33170)
0811 00:54:50.547868 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.547877 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.547907 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.548054 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.548054 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.548177 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.548213 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.548214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.548852 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.548853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.549314 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.549315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.549659 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.549659 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.549725 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.550159 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.550163 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.551213 (+ 1050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.552634 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.552635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.552636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.552823 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.553012 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.553012 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.553012 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.553055 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.553270 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.553270 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.553300 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.553341 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.553409 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 00:54:50.553978 3634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:50.554556 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.547678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33952 (local address 127.26.99.190:41681)
0811 00:54:50.547716 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.547717 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.547725 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:50.547744 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.547745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.547753 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.547812 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.548247 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.548762 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.549379 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.549581 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.549628 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.551818 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.551819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.551820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.551826 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.553343 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.553696 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.553698 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.553698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.553753 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.553931 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.553932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.553932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.554074 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.554205 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.554398 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.554478 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:54:50.560535 3636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.554200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43394)
0811 00:54:50.554287 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.554296 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.554340 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.554446 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.554447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.554581 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.554612 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.554614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.555365 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.555366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.555977 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.555979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.556317 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.556318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.556402 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.556718 (+ 316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.556723 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.558010 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.559532 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.559533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.559533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.559759 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.559950 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.559950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.559951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.560018 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.560259 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.560260 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.560295 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.560372 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.560480 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 00:54:50.560631 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.554251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43394 (local address 127.26.99.188:46197)
0811 00:54:50.554283 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.554285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.554327 (+ 42us) server_negotiation.cc:407] Connection header received
0811 00:54:50.554384 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.554385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.554393 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.554441 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.554678 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.555300 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.556056 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.556252 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.556313 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.558107 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.558108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.558108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.558114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.559435 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.559829 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.559830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.559830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.559885 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.560079 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.560080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.560080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.560196 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.560263 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.560410 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.560534 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":17}
I20260811 00:54:50.561902 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.555087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33174 (local address 127.26.99.189:34215)
0811 00:54:50.555118 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.555120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.555127 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:50.555150 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.555151 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.555158 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.555199 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.555640 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.556221 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.556854 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.557135 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.557200 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.559286 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.559287 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.559287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.559295 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.560954 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.561307 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.561308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.561308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.561352 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.561522 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.561522 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.561523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.561606 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.561713 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.561794 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.561847 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 00:54:50.562137 3634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: Bootstrap starting.
I20260811 00:54:50.563129 3634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:50.563341 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:50.563421 3634 log.cc:824] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:50.564148 3634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: No bootstrap required, opened a new log
I20260811 00:54:50.564553 3293 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7027894db70a4479b26113a4bf3f2c24"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33952
I20260811 00:54:50.565649 3336 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } attempt: 2
I20260811 00:54:50.566151 3634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.566298 3634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc0ede57dd3452495aa6c416235343f, State: Initialized, Role: FOLLOWER
I20260811 00:54:50.566402 3634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.566716 3634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:50.566697 3646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.566830 3646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:54:50.568434 3663 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:50.568529 3663 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:50.568747 3504 master_runner.cc:186] Error getting master registration for 127.26.99.190:41681: OK, instance_id { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" instance_seqno: 1786409690225082 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:54:50.571679 3504 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:54:50.572850 3349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.565877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43398)
0811 00:54:50.565983 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.565994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.566041 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.566136 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.566137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.566269 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.566305 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.566307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.567097 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.567098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.567879 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.567881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.568425 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.568426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.568484 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.568842 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.568847 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.570225 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.571810 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.571811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.571812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.571973 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.572133 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.572134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.572134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.572208 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.572560 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.572561 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.572605 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.572663 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.572752 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 00:54:50.572857 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.565933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.26.99.188:46197)
0811 00:54:50.565982 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.565984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.566027 (+ 43us) server_negotiation.cc:407] Connection header received
0811 00:54:50.566082 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.566083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.566092 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.566134 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.566362 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.567026 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.567962 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.568234 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.568290 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.570298 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.570299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.570299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.570305 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.571740 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.572033 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.572034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.572035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.572087 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.572279 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.572281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.572281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.572483 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.572556 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.572699 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.572778 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 00:54:50.574436 3336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: Bootstrap starting.
I20260811 00:54:50.575153 3336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:50.575479 3336 log.cc:824] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:50.576409 3336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: No bootstrap required, opened a new log
I20260811 00:54:50.577792 3336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.577940 3336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7027894db70a4479b26113a4bf3f2c24, State: Initialized, Role: FOLLOWER
I20260811 00:54:50.578037 3336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.578320 3667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.578366 3336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:50.578420 3667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.578421 3293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 00:54:50.578560 3293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:50.579245 3293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.579480 3293 leader_election.cc:288] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [CANDIDATE]: Term 1 election: Requested vote from peers b6d35e7ca2324c4fb15350736c83e098 (127.26.99.189:34215), 8fc0ede57dd3452495aa6c416235343f (127.26.99.188:46197)
I20260811 00:54:50.580681 3590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7027894db70a4479b26113a4bf3f2c24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8fc0ede57dd3452495aa6c416235343f"
I20260811 00:54:50.580803 3590 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [term 0 FOLLOWER]: Advancing to term 1
W20260811 00:54:50.581323 3689 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:50.581476 3689 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:50.581681 3590 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7027894db70a4479b26113a4bf3f2c24 in term 1.
I20260811 00:54:50.581933 3255 leader_election.cc:302] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7027894db70a4479b26113a4bf3f2c24, 8fc0ede57dd3452495aa6c416235343f; no voters:
I20260811 00:54:50.582087 3667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:50.582239 3667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [term 1 LEADER]: Becoming Leader. State: Replica: 7027894db70a4479b26113a4bf3f2c24, State: Running, Role: LEADER
I20260811 00:54:50.582321 3667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.582753 3667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7027894db70a4479b26113a4bf3f2c24. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.582844 3667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:50.581101 3207 master_runner.cc:186] Error getting master registration for 127.26.99.189:34215: OK, instance_id { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" instance_seqno: 1786409690367769 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:54:50.583578 3207 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:54:50.588476 3714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:50.589075 3714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:50.590734 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.580673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33954 (local address 127.26.99.190:41681)
0811 00:54:50.580789 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.580791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.582280 (+ 1489us) server_negotiation.cc:407] Connection header received
0811 00:54:50.582371 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.582372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.582394 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.582432 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.583166 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.583850 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.584933 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.585231 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.585269 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.587285 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.587287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.587287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.587294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.589072 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.589681 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.589682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.589682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.589752 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.590037 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.590037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.590038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.590173 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.590247 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.590567 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.590643 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 00:54:50.597625 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.581954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33182 (local address 127.26.99.189:34215)
0811 00:54:50.582008 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.582010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.589925 (+ 7915us) server_negotiation.cc:407] Connection header received
0811 00:54:50.590041 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.590043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.590054 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.590083 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.590729 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.591398 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.592414 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.592717 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.592760 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.594251 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.594252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.594252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.594260 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.595829 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.596226 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.596227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.596227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.596281 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.596595 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.596597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.596597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.596747 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.597212 (+ 465us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.597439 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.597530 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:54:50.598747 3590 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [term 1 FOLLOWER]: Refusing update from remote peer 7027894db70a4479b26113a4bf3f2c24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:50.599166 3707 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:50.599339 3489 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } attempt: 3
I20260811 00:54:50.600432 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.582405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.26.99.188:46197)
0811 00:54:50.582438 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.582440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.591225 (+ 8785us) server_negotiation.cc:407] Connection header received
0811 00:54:50.591365 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.591366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.591389 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.591417 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.592413 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.593158 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.594620 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.594928 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.594967 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.597011 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.597012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.597013 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.597020 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.598771 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.599322 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.599323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.599323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.599396 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.599709 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.599710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.599710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.599849 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.599934 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.600243 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.600320 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 00:54:50.600726 3646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7027894db70a4479b26113a4bf3f2c24. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.600822 3646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.602030 3667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.602116 3667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:50.602110 3646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.602171 3646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.602356 3716 mvcc.cc:205] Tried to move back new op lower bound from 7317134092689960960 to 7317134092626010112. Current Snapshot: MvccSnapshot[applied={T|T < 7317134092689960960}]
I20260811 00:54:50.603049 3718 mvcc.cc:205] Tried to move back new op lower bound from 7317134092689960960 to 7317134092626010112. Current Snapshot: MvccSnapshot[applied={T|T < 7317134092689960960}]
Aug 11 00:54:50 dist-test-slave-xt4k krb5kdc[3180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409690, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:50.608819 3714 catalog_manager.cc:1347] Generated new cluster ID: 29425e3436d64f4fa0ceb8a6ccf9313c
I20260811 00:54:50.608873 3714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:50.609335 3495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.599579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:46197 (local address 127.0.0.1:43420)
0811 00:54:50.599658 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:50.599667 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:50.599702 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:50.600603 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:50.600604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:50.600749 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:50.600792 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.600793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.601567 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.601569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.602355 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:50.602356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.603413 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.603414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:50.603501 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.603949 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:50.603954 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:50.605435 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:50.607863 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.607864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.607864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.608081 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.608313 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:50.608314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:50.608314 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:50.608468 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:50.609020 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:50.609022 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:50.609082 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 00:54:50.609140 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 00:54:50.609237 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 00:54:50.609844 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:50.599764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.26.99.188:46197)
0811 00:54:50.600507 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.600509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.600516 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:50.600532 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.600533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.600542 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.600596 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.600874 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.601501 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.602975 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:50.603293 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:50.603349 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:50.605522 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:50.605523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:50.605524 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:50.605531 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:50.607768 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.608176 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.608177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.608178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.608240 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:50.608558 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:50.608559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:50.608560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:50.608779 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:50.609452 (+ 673us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:50.609568 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 00:54:50.609701 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":96,"threads_started":1}
I20260811 00:54:50.611303 3489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: Bootstrap starting.
I20260811 00:54:50.612039 3489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:50.612330 3489 log.cc:824] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:50.613273 3489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: No bootstrap required, opened a new log
I20260811 00:54:50.614593 3714 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:50.615265 3489 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.615403 3489 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6d35e7ca2324c4fb15350736c83e098, State: Initialized, Role: FOLLOWER
I20260811 00:54:50.615478 3489 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } }
I20260811 00:54:50.615804 3489 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:50.615759 3731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.615836 3439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7027894db70a4479b26113a4bf3f2c24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b6d35e7ca2324c4fb15350736c83e098"
I20260811 00:54:50.615974 3435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:50.616101 3731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.616896 3435 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [term 1 FOLLOWER]: Refusing update from remote peer 7027894db70a4479b26113a4bf3f2c24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:50.617143 3714 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:50.617203 3667 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:50.617735 3439 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7027894db70a4479b26113a4bf3f2c24 in term 1.
I20260811 00:54:50.619161 3731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7027894db70a4479b26113a4bf3f2c24. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.619483 3731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.619535 3731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.619575 3731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:50.621397 3714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24: Generated new TSK 0
I20260811 00:54:50.621622 3714 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 00:54:50.622141 3759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:50.622303 3759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:50.623492 3707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7027894db70a4479b26113a4bf3f2c24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7027894db70a4479b26113a4bf3f2c24" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 41681 } } peers { permanent_uuid: "b6d35e7ca2324c4fb15350736c83e098" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 34215 } } peers { permanent_uuid: "8fc0ede57dd3452495aa6c416235343f" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 46197 } } }
I20260811 00:54:50.623592 3707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7027894db70a4479b26113a4bf3f2c24 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:50.627817 3754 mvcc.cc:205] Tried to move back new op lower bound from 7317134092750917632 to 7317134092626010112. Current Snapshot: MvccSnapshot[applied={T|T < 7317134092689960960}]
W20260811 00:54:50.645649 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.644287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.26.99.189:34215)
0811 00:54:50.644330 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.644332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.644986 (+ 654us) server_negotiation.cc:407] Connection header received
0811 00:54:50.645091 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.645092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.645103 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.645133 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.645581 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33186: BlockingRecv error: recv got EOF from 127.0.0.1:33186 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 00:54:50.646395 3640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.644714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.26.99.188:46197)
0811 00:54:50.644753 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.644755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.645883 (+ 1128us) server_negotiation.cc:407] Connection header received
0811 00:54:50.646004 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.646005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.646016 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.646045 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.646336 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43428: BlockingRecv error: recv got EOF from 127.0.0.1:43428 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 00:54:50.647358 3344 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.646733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33962 (local address 127.26.99.190:41681)
0811 00:54:50.646777 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.646779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.646863 (+ 84us) server_negotiation.cc:407] Connection header received
0811 00:54:50.646960 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.646961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.646972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.647000 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.647300 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33962: BlockingRecv error: recv got EOF from 127.0.0.1:33962 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 00:54:50.649590 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.648887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33188 (local address 127.26.99.189:34215)
0811 00:54:50.648941 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.648943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.649108 (+ 165us) server_negotiation.cc:407] Connection header received
0811 00:54:50.649205 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.649206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.649224 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.649251 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.649546 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33188: BlockingRecv error: recv got EOF from 127.0.0.1:33188 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 00:54:50.652495 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.651729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.26.99.189:34215)
0811 00:54:50.651760 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.651762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.652004 (+ 242us) server_negotiation.cc:407] Connection header received
0811 00:54:50.652093 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.652094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.652103 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.652128 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.652456 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33192: BlockingRecv error: recv got EOF from 127.0.0.1:33192 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 00:54:50.656165 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.655445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33208 (local address 127.26.99.189:34215)
0811 00:54:50.655487 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.655489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.655705 (+ 216us) server_negotiation.cc:407] Connection header received
0811 00:54:50.655790 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.655790 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.655800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.655825 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.656124 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33208: BlockingRecv error: recv got EOF from 127.0.0.1:33208 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 00:54:50.661846 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.661142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33210 (local address 127.26.99.189:34215)
0811 00:54:50.661173 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.661175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.661395 (+ 220us) server_negotiation.cc:407] Connection header received
0811 00:54:50.661482 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.661483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.661493 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.661519 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.661805 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33210: BlockingRecv error: recv got EOF from 127.0.0.1:33210 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 00:54:50.671754 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.670946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33224 (local address 127.26.99.189:34215)
0811 00:54:50.670985 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.670988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.671239 (+ 251us) server_negotiation.cc:407] Connection header received
0811 00:54:50.671333 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.671334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.671345 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.671371 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.671704 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33224: BlockingRecv error: recv got EOF from 127.0.0.1:33224 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 00:54:50.689966 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.689025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.26.99.189:34215)
0811 00:54:50.689067 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.689069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.689362 (+ 293us) server_negotiation.cc:407] Connection header received
0811 00:54:50.689467 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.689469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.689481 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.689509 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.689893 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33234: BlockingRecv error: recv got EOF from 127.0.0.1:33234 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 00:54:50.724255 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.723285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33250 (local address 127.26.99.189:34215)
0811 00:54:50.723334 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.723337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.723648 (+ 311us) server_negotiation.cc:407] Connection header received
0811 00:54:50.723751 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.723753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.723766 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.723795 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.724194 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33250: BlockingRecv error: recv got EOF from 127.0.0.1:33250 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 00:54:50.790211 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.789535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33258 (local address 127.26.99.189:34215)
0811 00:54:50.789613 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.789615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.789671 (+ 56us) server_negotiation.cc:407] Connection header received
0811 00:54:50.789740 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.789741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.789752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.789789 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.790155 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33258: BlockingRecv error: recv got EOF from 127.0.0.1:33258 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 00:54:50.919947 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:50.919285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.26.99.189:34215)
0811 00:54:50.919367 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:50.919369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:50.919455 (+ 86us) server_negotiation.cc:407] Connection header received
0811 00:54:50.919489 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:50.919490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:50.919502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:50.919553 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:50.919886 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33272: BlockingRecv error: recv got EOF from 127.0.0.1:33272 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 00:54:51.177778 3497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:51.177128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.26.99.189:34215)
0811 00:54:51.177199 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.177201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.177213 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:54:51.177279 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.177280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.177290 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.177343 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:51.177713 (+ 370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33274: BlockingRecv error: recv got EOF from 127.0.0.1:33274 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 00:54:51.569033 3663 catalog_manager.cc:1259] Loaded cluster ID: 29425e3436d64f4fa0ceb8a6ccf9313c
I20260811 00:54:51.569115 3663 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: loading cluster ID for follower catalog manager: success
I20260811 00:54:51.569921 3663 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: acquiring CA information for follower catalog manager: success
I20260811 00:54:51.570235 3663 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8fc0ede57dd3452495aa6c416235343f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:54:51.622805 3759 catalog_manager.cc:1259] Loaded cluster ID: 29425e3436d64f4fa0ceb8a6ccf9313c
I20260811 00:54:51.622886 3759 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: loading cluster ID for follower catalog manager: success
I20260811 00:54:51.623795 3759 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: acquiring CA information for follower catalog manager: success
I20260811 00:54:51.624104 3759 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b6d35e7ca2324c4fb15350736c83e098: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:54:51.693359 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:51.690989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.26.99.189:34215)
0811 00:54:51.691099 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.691101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.691111 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:51.691139 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.691140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.691190 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.691267 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:51.691415 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.691923 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.692732 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.692932 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.692985 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:51.693093 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:51.693205 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:51.693260 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:51.693272 (+ 12us) server_negotiation.cc:299] Negotiation successful
0811 00:54:51.693290 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
I20260811 00:54:51.697347 3899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:51.695017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43436 (local address 127.26.99.188:46197)
0811 00:54:51.695131 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.695132 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.695140 (+ 8us) server_negotiation.cc:407] Connection header received
0811 00:54:51.695182 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.695183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.695228 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.695298 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:51.695403 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.695880 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.696613 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.696827 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.696881 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:51.697023 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:51.697129 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:51.697191 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:51.697239 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 00:54:51.697262 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":48,"threads_started":1}
I20260811 00:54:51.701360 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:51.698931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33280 (local address 127.26.99.189:34215)
0811 00:54:51.698971 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.698973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.698999 (+ 26us) server_negotiation.cc:407] Connection header received
0811 00:54:51.699026 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.699026 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.699035 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.699085 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:51.699201 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.699747 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.700661 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.700955 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.701025 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:51.701138 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:51.701168 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:51.701210 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:51.701272 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 00:54:51.701290 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:54:51.701758 3899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:51.698936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43448 (local address 127.26.99.188:46197)
0811 00:54:51.699133 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.699135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.699141 (+ 6us) server_negotiation.cc:407] Connection header received
0811 00:54:51.699159 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.699160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.699172 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.699217 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:51.699375 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.700050 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.700934 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.701188 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.701245 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:51.701467 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:51.701502 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:51.701540 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:51.701669 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 00:54:51.701690 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178}
I20260811 00:54:51.702242 3918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:51.698829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33976 (local address 127.26.99.190:41681)
0811 00:54:51.699009 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:51.699011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:51.699183 (+ 172us) server_negotiation.cc:407] Connection header received
0811 00:54:51.699228 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:51.699229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:51.699280 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:51.699360 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:51.699588 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.700382 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.701376 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:51.701647 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:51.701710 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:51.701923 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:51.702017 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:51.702072 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:51.702139 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 00:54:51.702163 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":69,"threads_started":1}
I20260811 00:54:51.707090 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3207
I20260811 00:54:51.721966 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3360
I20260811 00:54:51.732947 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3504
2026-08-11T00:54:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2937 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 00:54:51 dist-test-slave-xt4k krb5kdc[3930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 00:54:51 dist-test-slave-xt4k krb5kdc[3930](info): set up 2 sockets
Aug 11 00:54:51 dist-test-slave-xt4k krb5kdc[3930](info): commencing operation
krb5kdc: starting...
W20260811 00:54:52.920706 27022 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/test-user.keytab.
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T00:54:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T00:54:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.99.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
Entry for principal kudu/127.26.99.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab.
I20260811 00:54:53.042821 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:45607
--webserver_interface=127.26.99.190
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 00:54:53.124850 3956 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:53.125056 3956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:53.125072 3956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:53.125098 3956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:53.126216 3956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:53.126255 3956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:53.126267 3956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:53.126279 3956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:53.126292 3956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:53.127808 3956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.190.keytab
--principal=kudu/127.26.99.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.190:45607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.99.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:53.128049 3956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:53.128269 3956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:53.133085 3965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:53.133050 3966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:53.133126 3956 server_base.cc:1034] running on GCE node
W20260811 00:54:53.133065 3970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:53.133512 3956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:53.133764 3956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:53.134904 3956 hybrid_clock.cc:648] HybridClock initialized: now 1786409693134892 us; error 31 us; skew 500 ppm
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:53.137413 3956 init.cc:377] Logged in from keytab as kudu/127.26.99.190@KRBTEST.COM (short username kudu)
I20260811 00:54:53.137873 3956 webserver.cc:460] Webserver started at http://127.26.99.190:34763/ using document root <none> and password file <none>
I20260811 00:54:53.138069 3956 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:53.138118 3956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:53.138238 3956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:53.139286 3956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data/instance:
uuid: "8373554a9fe145dbb4fbabb5c2788408"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "ddb0330a4710065b35702c4663cfda59"
server_key_iv: "05bb3f054d53947d81bc74ef6d577698"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.139626 3956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance:
uuid: "8373554a9fe145dbb4fbabb5c2788408"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "ddb0330a4710065b35702c4663cfda59"
server_key_iv: "05bb3f054d53947d81bc74ef6d577698"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.140964 3956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 00:54:53.141745 3979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:53.141968 3956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:53.142078 3956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal
uuid: "8373554a9fe145dbb4fbabb5c2788408"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "ddb0330a4710065b35702c4663cfda59"
server_key_iv: "05bb3f054d53947d81bc74ef6d577698"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.142146 3956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:53.152839 3956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:53.154843 3956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:53.154980 3956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:53.159416 3956 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.190:45607
I20260811 00:54:53.159503 4073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.190:45607 every 8 connection(s)
I20260811 00:54:53.159830 3956 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/data/info.pb
I20260811 00:54:53.160890 4075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:53.162456 4075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.167964 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 3956
I20260811 00:54:53.168062 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-0/wal/instance
I20260811 00:54:53.168239 27022 external_mini_cluster.cc:1428] Setting key f79a19206d3a2c711f5a066c49e5f073
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:53.172073 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.163142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45607 (local address 127.0.0.1:58434)
0811 00:54:53.163318 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.163358 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.163838 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.164132 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.164134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.164397 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.164567 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.164572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.165614 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.165616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.166298 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.166301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.166826 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.166827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.166885 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.167324 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.167331 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.168887 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.170533 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.170541 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.170544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.170792 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.171026 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.171027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.171027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.171122 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.171562 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.171569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.171631 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.171731 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.171861 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260811 00:54:53.172087 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.163185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.26.99.190:45607)
0811 00:54:53.163327 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.163335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.163440 (+ 105us) server_negotiation.cc:407] Connection header received
0811 00:54:53.164002 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.164005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.164033 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.164120 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.164649 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.165509 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.166375 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.166721 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.166808 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.168990 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.168998 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.168998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.169004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.170452 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.170886 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.170888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.170889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.170967 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.171202 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.171203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.171204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.171469 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.171553 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.171786 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.171939 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260811 00:54:53.173146 4075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.173767 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.173545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47454)
0811 00:54:53.173607 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.173741 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 00:54:53.173950 3988 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
I20260811 00:54:53.174453 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.174365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47470)
0811 00:54:53.174412 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.174437 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 00:54:53.174564 4075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41455: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.99.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
Entry for principal kudu/127.26.99.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab.
I20260811 00:54:53.194984 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:41455
--webserver_interface=127.26.99.189
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:54:53.223793 4075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } attempt: 1
I20260811 00:54:53.224373 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.224206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47472)
0811 00:54:53.224270 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.224315 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 00:54:53.224825 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.224688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47486)
0811 00:54:53.224771 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.224802 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 00:54:53.224934 4075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41455: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
W20260811 00:54:53.276916 4089 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:53.277118 4089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:53.277133 4089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:53.277151 4089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:53.278199 4089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:53.278235 4089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:53.278249 4089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:53.278260 4089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:53.278270 4089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:53.279707 4089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.189.keytab
--principal=kudu/127.26.99.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.189:41455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.99.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:53.279897 4089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:53.280072 4089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:53.284632 4097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:53.284650 4104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:53.284641 4098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:53.284930 4089 server_base.cc:1034] running on GCE node
I20260811 00:54:53.285163 4089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:53.285401 4089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:53.286571 4089 hybrid_clock.cc:648] HybridClock initialized: now 1786409693286552 us; error 34 us; skew 500 ppm
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:53.289065 4089 init.cc:377] Logged in from keytab as kudu/127.26.99.189@KRBTEST.COM (short username kudu)
I20260811 00:54:53.289527 4089 webserver.cc:460] Webserver started at http://127.26.99.189:39691/ using document root <none> and password file <none>
I20260811 00:54:53.289762 4089 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:53.289810 4089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:53.289940 4089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:53.290959 4089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data/instance:
uuid: "7a059badf36b4fe08522cc6fa842e031"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "c972dee81e7a8c7a7c6e752f4d1cbb5b"
server_key_iv: "81abc31ddc9916c55c18627f80523482"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.291283 4089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal/instance:
uuid: "7a059badf36b4fe08522cc6fa842e031"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "c972dee81e7a8c7a7c6e752f4d1cbb5b"
server_key_iv: "81abc31ddc9916c55c18627f80523482"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.292579 4089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 00:54:53.293072 4075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } attempt: 2
I20260811 00:54:53.293279 4117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:53.293437 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.293307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47494)
0811 00:54:53.293362 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.293405 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 00:54:53.293478 4089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:53.293565 4089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal
uuid: "7a059badf36b4fe08522cc6fa842e031"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "c972dee81e7a8c7a7c6e752f4d1cbb5b"
server_key_iv: "81abc31ddc9916c55c18627f80523482"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.293642 4089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:53.293798 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.293710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47500)
0811 00:54:53.293744 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.293774 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 00:54:53.293877 4075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.189:41455: Network error: Client connection negotiation failed: client connection to 127.26.99.189:41455: connect: Connection refused (error 111)
I20260811 00:54:53.303083 4089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 00:54:53.305112 4089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:53.305234 4089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:53.308975 4089 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.189:41455
I20260811 00:54:53.309011 4206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.189:41455 every 8 connection(s)
I20260811 00:54:53.309321 4089 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/data/info.pb
I20260811 00:54:53.309983 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4089
I20260811 00:54:53.310068 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-1/wal/instance
I20260811 00:54:53.310248 27022 external_mini_cluster.cc:1428] Setting key e358f4c23450a65056445f0567369171
I20260811 00:54:53.310312 4207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:53.311851 4207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.99.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.99.188@KRBTEST.COM" created.
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:53.325604 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.312654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58450 (local address 127.26.99.190:45607)
0811 00:54:53.312715 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.312718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.316765 (+ 4047us) server_negotiation.cc:407] Connection header received
0811 00:54:53.317448 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.317450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.317461 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.317525 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.318345 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.318850 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.319834 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.320092 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.320196 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.322628 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.322630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.322630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.322638 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.324098 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.324514 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.324516 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.324516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.324585 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.324863 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.324864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.324864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.325021 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.325087 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.325403 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.325498 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 00:54:53.325696 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.312599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45607 (local address 127.0.0.1:58450)
0811 00:54:53.316595 (+ 3996us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.316644 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.317313 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.317608 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.317613 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.317931 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.318235 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.318242 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.318925 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.318926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.319744 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.319747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.320200 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.320201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.320330 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.320851 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.320861 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.322516 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.324182 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.324189 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.324191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.324442 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.324674 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.324675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.324675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.324790 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.325103 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.325110 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.325240 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.325333 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.325499 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3930,"thread_start_us":90,"threads_started":1}
I20260811 00:54:53.326280 4207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:54:53.334558 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.326536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47502)
0811 00:54:53.326714 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.326725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.326767 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.326888 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.326889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.327017 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.327068 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.327069 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.327905 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.327906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.328443 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.328445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.329052 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.329054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.329121 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.329495 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.329500 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.332101 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.333587 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.333588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.333588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.333737 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.333916 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.333916 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.333917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.333969 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.334225 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.334226 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.334264 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.334326 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.334426 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 00:54:53.334633 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.326601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47502 (local address 127.26.99.189:41455)
0811 00:54:53.326737 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.326742 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.326765 (+ 23us) server_negotiation.cc:407] Connection header received
0811 00:54:53.326814 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.326816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.326829 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.326890 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.327131 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.327826 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.328505 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.328937 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.329069 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.332177 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.332185 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.332186 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.332192 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.333511 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.333804 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.333807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.333808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.333864 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.334026 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.334027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.334027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.334166 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.334235 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.334363 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.334495 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260811 00:54:53.335194 4207 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.335536 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.335413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53060)
0811 00:54:53.335452 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.335496 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 00:54:53.335672 4118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
I20260811 00:54:53.336089 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.336004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53074)
0811 00:54:53.336048 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.336072 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 00:54:53.336176 4207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:42431: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
Entry for principal kudu/127.26.99.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab.
I20260811 00:54:53.338603 27022 external_mini_cluster.cc:1326] Running /tmp/dist-test-task7ONN3e/build/release/bin/kudu
/tmp/dist-test-task7ONN3e/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:42431
--webserver_interface=127.26.99.188
--webserver_port=0
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.99.148:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 00:54:53.385031 4075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } attempt: 3
I20260811 00:54:53.385382 4207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } attempt: 1
I20260811 00:54:53.385792 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.385671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53076)
0811 00:54:53.385719 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.385755 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 00:54:53.386163 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.386059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53082)
0811 00:54:53.386106 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.386136 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 00:54:53.386246 4207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:42431: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:54:53.392171 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.385428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47504)
0811 00:54:53.385523 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.385534 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.385588 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.385778 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.385779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.385967 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.386055 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.386058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.386789 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.386791 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.387644 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.387647 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.388000 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.388001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.388081 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.388508 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.388513 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.389801 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.391347 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.391348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.391348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.391507 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.391686 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.391687 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.391687 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.391731 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.391957 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.391957 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.392000 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.392042 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.392109 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 00:54:53.392241 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.385518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.26.99.189:41455)
0811 00:54:53.385565 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.385567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.385578 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:53.385665 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.385667 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.385681 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.385765 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.386146 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.386711 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.387717 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.387942 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.387997 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.389878 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.389879 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.389880 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.389887 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.391275 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.391570 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.391571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.391571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.391627 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.391775 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.391776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.391776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.391904 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.391968 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.392077 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.392154 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 00:54:53.392552 4075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.392849 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.392766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53092)
0811 00:54:53.392805 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.392830 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 00:54:53.393160 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.393077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53096)
0811 00:54:53.393117 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.393139 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 00:54:53.393240 4075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:42431: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
W20260811 00:54:53.422361 4221 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 00:54:53.422591 4221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 00:54:53.422607 4221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 00:54:53.422626 4221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 00:54:53.423732 4221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 00:54:53.423770 4221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 00:54:53.423784 4221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 00:54:53.423794 4221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 00:54:53.423804 4221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 00:54:53.424368 4075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } attempt: 1
I20260811 00:54:53.424803 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.424681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53112)
0811 00:54:53.424744 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.424775 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 00:54:53.425109 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.425031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53118)
0811 00:54:53.425068 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.425092 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 00:54:53.425194 4075 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:42431: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
I20260811 00:54:53.425468 4221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.99.148:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.99.190:45607,127.26.99.189:41455,127.26.99.188:42431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/krb5kdc/kudu_127.26.99.188.keytab
--principal=kudu/127.26.99.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.99.188:42431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.99.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 00:01:25 UTC on ccycloud.quasar-jpfplx.root.comops.site
build id 4579414
I20260811 00:54:53.425670 4221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 00:54:53.425840 4221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 00:54:53.430411 4232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:53.430378 4230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 00:54:53.430397 4229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 00:54:53.430604 4221 server_base.cc:1034] running on GCE node
I20260811 00:54:53.430855 4221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 00:54:53.431143 4221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 00:54:53.432294 4221 hybrid_clock.cc:648] HybridClock initialized: now 1786409693432275 us; error 28 us; skew 500 ppm
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 00:54:53.434841 4221 init.cc:377] Logged in from keytab as kudu/127.26.99.188@KRBTEST.COM (short username kudu)
I20260811 00:54:53.435251 4221 webserver.cc:460] Webserver started at http://127.26.99.188:45197/ using document root <none> and password file <none>
I20260811 00:54:53.435444 4221 fs_manager.cc:359] Metadata directory not provided
I20260811 00:54:53.435491 4221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 00:54:53.435616 4221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 00:54:53.436677 4221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data/instance:
uuid: "d88adc3bd776465cbb5008143055c3de"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "10b318fa5438606c6c7f5e471d4ce2aa"
server_key_iv: "5b67683886271629ff85ca9d1cb36d31"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.437119 4221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal/instance:
uuid: "d88adc3bd776465cbb5008143055c3de"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "10b318fa5438606c6c7f5e471d4ce2aa"
server_key_iv: "5b67683886271629ff85ca9d1cb36d31"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.438441 4221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 00:54:53.439337 4241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 00:54:53.439558 4221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 00:54:53.439652 4221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data,/tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal
uuid: "d88adc3bd776465cbb5008143055c3de"
format_stamp: "Formatted at 2026-08-11 00:54:53 on dist-test-slave-xt4k"
server_key: "10b318fa5438606c6c7f5e471d4ce2aa"
server_key_iv: "5b67683886271629ff85ca9d1cb36d31"
server_key_version: "encryptionkey@0"
I20260811 00:54:53.439728 4221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 00:54:53.454377 4207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } attempt: 2
I20260811 00:54:53.454769 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.454656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53132)
0811 00:54:53.454709 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.454738 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 00:54:53.455123 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.455000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53140)
0811 00:54:53.455055 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.455094 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 00:54:53.455108 4221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260811 00:54:53.455216 4207 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.99.188:42431: Network error: Client connection negotiation failed: client connection to 127.26.99.188:42431: connect: Connection refused (error 111)
I20260811 00:54:53.456980 4221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 00:54:53.457088 4221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 00:54:53.460836 4221 rpc_server.cc:307] RPC server started. Bound to: 127.26.99.188:42431
I20260811 00:54:53.460879 4336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.99.188:42431 every 8 connection(s)
I20260811 00:54:53.461191 4221 server_base.cc:1166] Dumped server information to /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/data/info.pb
I20260811 00:54:53.462162 4337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 00:54:53.463677 4337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.463990 27022 external_mini_cluster.cc:1388] Started /tmp/dist-test-task7ONN3e/build/release/bin/kudu as pid 4221
I20260811 00:54:53.464110 27022 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task7ONN3e/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786409417711920-27022-0/minicluster-data/master-2/wal/instance
I20260811 00:54:53.464296 27022 external_mini_cluster.cc:1428] Setting key 3a9932d07e124a464655746d3766c880
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:53.472875 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.464454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.26.99.190:45607)
0811 00:54:53.464522 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.464524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.464798 (+ 274us) server_negotiation.cc:407] Connection header received
0811 00:54:53.465341 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.465342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.465354 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.465408 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.465943 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.466440 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.467285 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.467488 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.467545 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.469854 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.469855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.469856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.469863 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.471394 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.471871 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.471872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.471873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.471943 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.472183 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.472184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.472184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.472313 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.472419 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.472687 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.472786 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 00:54:53.473059 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.464462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.190:45607 (local address 127.0.0.1:58464)
0811 00:54:53.464641 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.464683 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.465242 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.465429 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.465432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.465684 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.465841 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.465845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.466509 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.466511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.467208 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.467210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.467578 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.467579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.467687 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.468144 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.468154 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.469746 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.471473 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.471480 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.471482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.471788 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.472012 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.472013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.472013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.472118 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.472400 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.472407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.472565 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.472661 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.472816 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260811 00:54:53.473062 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.464861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53144 (local address 127.26.99.188:42431)
0811 00:54:53.465002 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.465007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.465035 (+ 28us) server_negotiation.cc:407] Connection header received
0811 00:54:53.465250 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.465256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.465279 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.465369 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.466006 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.466806 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.467508 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.467802 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.467860 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.470266 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.470274 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.470274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.470281 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.471773 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.472167 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.472170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.472171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.472222 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.472412 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.472413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.472413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.472592 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.472741 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.472833 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.472899 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260811 00:54:53.473713 4337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.190@KRBTEST.COM
I20260811 00:54:53.479875 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.473978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.189:41455 (local address 127.0.0.1:47512)
0811 00:54:53.474083 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.474093 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.474134 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.474255 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.474256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.474363 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.474394 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.474395 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.475037 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.475535 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.475537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.475889 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.475954 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.476450 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.476455 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.477610 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.479038 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.479039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.479039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.479199 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.479364 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.479364 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.479365 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.479420 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.479641 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.479641 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.479679 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.479725 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.479790 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 00:54:53.479918 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.474038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47512 (local address 127.26.99.189:41455)
0811 00:54:53.474090 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.474092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.474124 (+ 32us) server_negotiation.cc:407] Connection header received
0811 00:54:53.474184 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.474186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.474195 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.474253 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.474454 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.474973 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475608 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.475829 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475885 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.477693 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.477695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.477695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.477702 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.478956 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.479258 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.479259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.479260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.479311 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.479469 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.479470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.479470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.479580 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.479639 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.479763 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.479833 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 00:54:53.480249 4337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } has no permanent_uuid. Determining permanent_uuid...
I20260811 00:54:53.480870 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.473892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58476 (local address 127.26.99.190:45607)
0811 00:54:53.473933 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.473935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.473986 (+ 51us) server_negotiation.cc:407] Connection header received
0811 00:54:53.474061 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.474062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.474072 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.474128 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.474598 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.475045 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475653 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.475822 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.475872 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.478315 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.478316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.478316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.478322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.479520 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.479855 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.479856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.479857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.479921 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.480116 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.480118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.480118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.480498 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.480661 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.480704 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.480780 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.188@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.99.189@KRBTEST.COM
I20260811 00:54:53.486815 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.480590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53152)
0811 00:54:53.480637 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.480646 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.480680 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.480800 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.480801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.480929 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.480961 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.480963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.481649 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.481650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.482343 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.482345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.482804 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.482805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.482846 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.483139 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.483144 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.484573 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.485957 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.485957 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.485958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.486107 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.486269 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.486270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.486270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.486321 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.486521 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.486521 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.486558 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.486617 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.486713 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:54:53.486863 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.480667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53152 (local address 127.26.99.188:42431)
0811 00:54:53.480698 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.480700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.480707 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:53.480723 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.480724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.480733 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.480794 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.481030 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.481599 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.482420 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.482732 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.482795 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.484665 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.484666 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.484667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.484672 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.485887 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.486164 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.486165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.486166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.486218 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.486370 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.486371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.486371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.486469 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.486522 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.486642 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.486760 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":16}
I20260811 00:54:53.488305 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.481455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47514 (local address 127.26.99.189:41455)
0811 00:54:53.481486 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.481488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.481542 (+ 54us) server_negotiation.cc:407] Connection header received
0811 00:54:53.481606 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.481607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.481616 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.481659 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.482211 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.482820 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.483724 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.484014 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.484093 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.486086 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.486087 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.486088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.486094 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.487374 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.487668 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.487669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.487669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.487717 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.487874 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.487874 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.487875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.487973 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.488123 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.488159 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.488222 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260811 00:54:53.488421 4337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: Bootstrap starting.
I20260811 00:54:53.489395 4337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:53.489711 4337 log.cc:824] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:53.490202 27022 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 00:54:53.490581 4337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: No bootstrap required, opened a new log
I20260811 00:54:53.491384 4033 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8373554a9fe145dbb4fbabb5c2788408"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58476
I20260811 00:54:53.492174 4337 raft_consensus.cc:348] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.492314 4337 raft_consensus.cc:729] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88adc3bd776465cbb5008143055c3de, State: Initialized, Role: FOLLOWER
I20260811 00:54:53.492429 4337 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.492723 4337 sys_catalog.cc:564] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:53.492695 4344 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.492797 4344 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: This master's current role is: FOLLOWER
W20260811 00:54:53.494307 4368 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:53.494364 4368 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:53.494640 4221 master_runner.cc:186] Error getting master registration for 127.26.99.190:45607: OK, instance_id { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" instance_seqno: 1786409693158235 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:54:53.497394 4221 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:54:53.500382 4075 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } attempt: 2
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.190@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:53.507388 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.500673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53160)
0811 00:54:53.500726 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.500737 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.500779 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.500919 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.500920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.501075 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.501119 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.501120 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.502027 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.502028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.502546 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.502548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.502979 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.502980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.503044 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.503457 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.503462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.504618 (+ 1156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.506335 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.506336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.506337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.506552 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.506736 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.506737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.506737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.506795 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.507085 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.507086 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.507132 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.507192 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.507286 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 00:54:53.507401 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.500731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53160 (local address 127.26.99.188:42431)
0811 00:54:53.500774 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.500776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.500786 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:53.500840 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.500841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.500852 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.500917 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.501167 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.501915 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.502619 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.502910 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.502983 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.504709 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.504711 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.504711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.504718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.506239 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.506620 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.506621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.506621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.506678 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.506845 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.506846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.506847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.507020 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.507084 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.507222 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.507302 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:54:53.508781 4075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: Bootstrap starting.
I20260811 00:54:53.509393 4075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:53.509681 4075 log.cc:824] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:53.510535 4075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: No bootstrap required, opened a new log
I20260811 00:54:53.511533 4075 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.511646 4075 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8373554a9fe145dbb4fbabb5c2788408, State: Initialized, Role: FOLLOWER
I20260811 00:54:53.511720 4075 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.511972 4372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.512038 4075 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:53.512090 4372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.512135 4033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 00:54:53.512218 4033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:53.513048 4033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
W20260811 00:54:53.513821 4390 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:53.513896 4390 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:53.514755 4294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8373554a9fe145dbb4fbabb5c2788408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d88adc3bd776465cbb5008143055c3de"
I20260811 00:54:53.514883 4294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:53.515796 4294 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373554a9fe145dbb4fbabb5c2788408 in term 1.
I20260811 00:54:53.515024 3956 master_runner.cc:186] Error getting master registration for 127.26.99.189:41455: OK, instance_id { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" instance_seqno: 1786409693307880 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 00:54:53.517310 3956 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 00:54:53.517431 3983 leader_election.cc:302] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8373554a9fe145dbb4fbabb5c2788408, d88adc3bd776465cbb5008143055c3de; no voters:
I20260811 00:54:53.517551 4372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 00:54:53.517701 4372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [term 1 LEADER]: Becoming Leader. State: Replica: 8373554a9fe145dbb4fbabb5c2788408, State: Running, Role: LEADER
I20260811 00:54:53.517807 4372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.518384 4033 leader_election.cc:288] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [CANDIDATE]: Term 1 election: Requested vote from peers 7a059badf36b4fe08522cc6fa842e031 (127.26.99.189:41455), d88adc3bd776465cbb5008143055c3de (127.26.99.188:42431)
I20260811 00:54:53.518405 4392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8373554a9fe145dbb4fbabb5c2788408. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.518795 4392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:53.530728 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.519755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53166 (local address 127.26.99.188:42431)
0811 00:54:53.519809 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.519811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.520110 (+ 299us) server_negotiation.cc:407] Connection header received
0811 00:54:53.520205 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.520206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.520217 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.520267 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.521034 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.521845 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.523904 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.524219 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.524291 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.527580 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.527582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.527582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.527591 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.529291 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.529642 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.529643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.529644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.529720 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.530002 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.530003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.530003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.530148 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.530222 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.530542 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.530625 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:54:53.534189 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.519587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.26.99.190:45607)
0811 00:54:53.519630 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.519632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.520233 (+ 601us) server_negotiation.cc:407] Connection header received
0811 00:54:53.521102 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.521103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.521113 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.521141 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.521821 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.522586 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.525980 (+ 3394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.526291 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.526333 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.529673 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.529674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.529675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.529682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.531243 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.531622 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.531623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.531624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.531679 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.532963 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.532964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.532965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.533106 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.533506 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.533733 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.533820 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 00:54:53.535938 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.519911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47520 (local address 127.26.99.189:41455)
0811 00:54:53.519966 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.519968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.528521 (+ 8553us) server_negotiation.cc:407] Connection header received
0811 00:54:53.528588 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.528590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.528602 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.528632 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.529267 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.529965 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.531033 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.531314 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.531358 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.532894 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.532895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.532895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.532904 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.534710 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.535151 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.535152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.535152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.535230 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.535407 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.535407 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.535408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.535549 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.535639 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.535757 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.535847 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 00:54:53.543380 4394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 00:54:53.543637 4394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 00:54:53.545979 4294 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [term 1 FOLLOWER]: Refusing update from remote peer 8373554a9fe145dbb4fbabb5c2788408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:53.546305 4392 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:53.546334 4207 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } attempt: 3
I20260811 00:54:53.547760 4344 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8373554a9fe145dbb4fbabb5c2788408. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.547856 4344 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.549610 4392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.549803 4392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: This master's current role is: LEADER
I20260811 00:54:53.550609 4344 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.550697 4344 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.551004 4409 mvcc.cc:205] Tried to move back new op lower bound from 7317134104761106432 to 7317134104650170368. Current Snapshot: MvccSnapshot[applied={T|T < 7317134104761106432}]
I20260811 00:54:53.551872 4410 mvcc.cc:205] Tried to move back new op lower bound from 7317134104761106432 to 7317134104650170368. Current Snapshot: MvccSnapshot[applied={T|T < 7317134104761106432}]
Aug 11 00:54:53 dist-test-slave-xt4k krb5kdc[3930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786409693, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.99.189@KRBTEST.COM for kudu/127.26.99.188@KRBTEST.COM
I20260811 00:54:53.552785 4394 catalog_manager.cc:1347] Generated new cluster ID: c8e37af553a4497f8621b15d12a4d363
I20260811 00:54:53.552827 4394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 00:54:53.556391 4210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.546591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.99.188:42431 (local address 127.0.0.1:53170)
0811 00:54:53.546634 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 00:54:53.546644 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 00:54:53.546678 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 00:54:53.547104 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 00:54:53.547105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 00:54:53.547296 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 00:54:53.547369 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.547371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.548553 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.548554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.549380 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 00:54:53.549382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.550047 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.550049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 00:54:53.550127 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.551578 (+ 1451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 00:54:53.551584 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 00:54:53.553225 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 00:54:53.555073 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.555075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.555075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.555293 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.555591 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 00:54:53.555591 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 00:54:53.555592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 00:54:53.555662 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 00:54:53.556055 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 00:54:53.556056 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 00:54:53.556116 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 00:54:53.556163 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 00:54:53.556268 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 00:54:53.557188 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:53.546781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53170 (local address 127.26.99.188:42431)
0811 00:54:53.546960 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.546962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.546969 (+ 7us) server_negotiation.cc:407] Connection header received
0811 00:54:53.547001 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.547002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.547012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.547452 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.547499 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.548440 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.549529 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:53.549950 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:53.550310 (+ 360us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:53.553333 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 00:54:53.553335 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 00:54:53.553335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 00:54:53.553342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 00:54:53.554963 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.555387 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.555388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.555388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.555504 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 00:54:53.555737 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 00:54:53.555738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 00:54:53.555738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 00:54:53.555940 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 00:54:53.556859 (+ 919us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:53.556925 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 00:54:53.557055 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260811 00:54:53.558979 4207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: Bootstrap starting.
I20260811 00:54:53.559708 4207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: Neither blocks nor log segments found. Creating new log.
I20260811 00:54:53.560005 4207 log.cc:824] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: Log is configured to *not* fsync() on all Append() calls
I20260811 00:54:53.561959 4207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: No bootstrap required, opened a new log
I20260811 00:54:53.563549 4394 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 00:54:53.564031 4207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.564167 4207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a059badf36b4fe08522cc6fa842e031, State: Initialized, Role: FOLLOWER
I20260811 00:54:53.564241 4207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } }
I20260811 00:54:53.564690 4394 catalog_manager.cc:1504] Loading token signing keys...
I20260811 00:54:53.564764 4207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 00:54:53.564893 4165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [term 0 FOLLOWER]: Advancing to term 1
I20260811 00:54:53.565841 4165 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [term 1 FOLLOWER]: Refusing update from remote peer 8373554a9fe145dbb4fbabb5c2788408: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 00:54:53.566143 4372 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 00:54:53.566144 4168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8373554a9fe145dbb4fbabb5c2788408" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7a059badf36b4fe08522cc6fa842e031"
I20260811 00:54:53.567180 4168 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8373554a9fe145dbb4fbabb5c2788408 in term 1.
W20260811 00:54:53.568583 4440 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 00:54:53.568735 4440 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 00:54:53.570083 4418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.570310 4418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.570400 4418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8373554a9fe145dbb4fbabb5c2788408. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.570510 4418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.572392 4418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.572530 4418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 00:54:53.576730 4394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408: Generated new TSK 0
I20260811 00:54:53.576920 4394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 00:54:53.577417 4445 mvcc.cc:205] Tried to move back new op lower bound from 7317134104830189568 to 7317134104650170368. Current Snapshot: MvccSnapshot[applied={T|T < 7317134104761106432}]
I20260811 00:54:53.581368 4392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8373554a9fe145dbb4fbabb5c2788408" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8373554a9fe145dbb4fbabb5c2788408" member_type: VOTER last_known_addr { host: "127.26.99.190" port: 45607 } } peers { permanent_uuid: "7a059badf36b4fe08522cc6fa842e031" member_type: VOTER last_known_addr { host: "127.26.99.189" port: 41455 } } peers { permanent_uuid: "d88adc3bd776465cbb5008143055c3de" member_type: VOTER last_known_addr { host: "127.26.99.188" port: 42431 } } }
I20260811 00:54:53.581485 4392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8373554a9fe145dbb4fbabb5c2788408 [sys.catalog]: This master's current role is: LEADER
W20260811 00:54:53.600502 4081 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.599064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58496 (local address 127.26.99.190:45607)
0811 00:54:53.599111 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.599114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.599762 (+ 648us) server_negotiation.cc:407] Connection header received
0811 00:54:53.599876 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.599878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.599889 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.599919 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.600426 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58496: BlockingRecv error: recv got EOF from 127.0.0.1:58496 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 00:54:53.601404 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.599446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47524 (local address 127.26.99.189:41455)
0811 00:54:53.599486 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.599488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.600721 (+ 1233us) server_negotiation.cc:407] Connection header received
0811 00:54:53.600910 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.600912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.600923 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.600954 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.601339 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47524: BlockingRecv error: recv got EOF from 127.0.0.1:47524 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 00:54:53.602471 4342 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.601745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.26.99.188:42431)
0811 00:54:53.601787 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.601789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.601912 (+ 123us) server_negotiation.cc:407] Connection header received
0811 00:54:53.602020 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.602022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.602033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.602063 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.602407 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53184: BlockingRecv error: recv got EOF from 127.0.0.1:53184 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 00:54:53.609565 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.608667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47534 (local address 127.26.99.189:41455)
0811 00:54:53.608720 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.608722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.608962 (+ 240us) server_negotiation.cc:407] Connection header received
0811 00:54:53.609078 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.609079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.609100 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.609131 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.609509 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47534: BlockingRecv error: recv got EOF from 127.0.0.1:47534 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 00:54:53.612896 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.612025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47548 (local address 127.26.99.189:41455)
0811 00:54:53.612062 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.612064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.612307 (+ 243us) server_negotiation.cc:407] Connection header received
0811 00:54:53.612446 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.612447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.612459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.612488 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.612831 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47548: BlockingRecv error: recv got EOF from 127.0.0.1:47548 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 00:54:53.617038 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.616106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.26.99.189:41455)
0811 00:54:53.616142 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.616143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.616496 (+ 353us) server_negotiation.cc:407] Connection header received
0811 00:54:53.616598 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.616599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.616610 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.616640 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.616987 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47564: BlockingRecv error: recv got EOF from 127.0.0.1:47564 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 00:54:53.623025 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.622154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.26.99.189:41455)
0811 00:54:53.622204 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.622206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.622479 (+ 273us) server_negotiation.cc:407] Connection header received
0811 00:54:53.622576 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.622577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.622589 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.622616 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.622957 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47572: BlockingRecv error: recv got EOF from 127.0.0.1:47572 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 00:54:53.633445 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.632327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47576 (local address 127.26.99.189:41455)
0811 00:54:53.632473 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.632476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.632794 (+ 318us) server_negotiation.cc:407] Connection header received
0811 00:54:53.632916 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.632918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.632931 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.632963 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.633381 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47576: BlockingRecv error: recv got EOF from 127.0.0.1:47576 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
W20260811 00:54:53.651646 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.650710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47590 (local address 127.26.99.189:41455)
0811 00:54:53.650754 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.650756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.651047 (+ 291us) server_negotiation.cc:407] Connection header received
0811 00:54:53.651146 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.651148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.651160 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.651191 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.651581 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47590: BlockingRecv error: recv got EOF from 127.0.0.1:47590 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 00:54:53.685633 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.684942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.26.99.189:41455)
0811 00:54:53.685000 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.685003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.685131 (+ 128us) server_negotiation.cc:407] Connection header received
0811 00:54:53.685183 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.685184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.685197 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.685244 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.685575 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47596: BlockingRecv error: recv got EOF from 127.0.0.1:47596 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 00:54:53.751323 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.750667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47600 (local address 127.26.99.189:41455)
0811 00:54:53.750736 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.750739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.750867 (+ 128us) server_negotiation.cc:407] Connection header received
0811 00:54:53.750901 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.750902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.750913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.750956 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.751261 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47600: BlockingRecv error: recv got EOF from 127.0.0.1:47600 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 00:54:53.881275 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:53.880550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47604 (local address 127.26.99.189:41455)
0811 00:54:53.880630 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:53.880633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:53.880724 (+ 91us) server_negotiation.cc:407] Connection header received
0811 00:54:53.880799 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:53.880800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:53.880812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:53.880863 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:53.881209 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47604: BlockingRecv error: recv got EOF from 127.0.0.1:47604 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 00:54:54.139055 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 00:54:54.138464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47618 (local address 127.26.99.189:41455)
0811 00:54:54.138540 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.138542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.138552 (+ 10us) server_negotiation.cc:407] Connection header received
0811 00:54:54.138582 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.138583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.138594 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.138643 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 00:54:54.138987 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47618: BlockingRecv error: recv got EOF from 127.0.0.1:47618 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 00:54:54.494825 4368 catalog_manager.cc:1259] Loaded cluster ID: c8e37af553a4497f8621b15d12a4d363
I20260811 00:54:54.494916 4368 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: loading cluster ID for follower catalog manager: success
I20260811 00:54:54.495726 4368 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: acquiring CA information for follower catalog manager: success
I20260811 00:54:54.496050 4368 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d88adc3bd776465cbb5008143055c3de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:54:54.569226 4440 catalog_manager.cc:1259] Loaded cluster ID: c8e37af553a4497f8621b15d12a4d363
I20260811 00:54:54.569311 4440 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: loading cluster ID for follower catalog manager: success
I20260811 00:54:54.570132 4440 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: acquiring CA information for follower catalog manager: success
I20260811 00:54:54.570433 4440 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a059badf36b4fe08522cc6fa842e031: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 00:54:54.655143 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:54.652151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47624 (local address 127.26.99.189:41455)
0811 00:54:54.652371 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.652373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.652385 (+ 12us) server_negotiation.cc:407] Connection header received
0811 00:54:54.652414 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.652415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.652471 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.652558 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:54.652763 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.653356 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.654169 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.654372 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.654426 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:54.654623 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:54.654760 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:54.654985 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:54.655010 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 00:54:54.655039 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":94,"threads_started":1}
I20260811 00:54:54.659415 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:54.656956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53198 (local address 127.26.99.188:42431)
0811 00:54:54.657076 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.657078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.657130 (+ 52us) server_negotiation.cc:407] Connection header received
0811 00:54:54.657198 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.657199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.657236 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.657303 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:54.657380 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.658038 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.658794 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.658987 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.659043 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:54.659136 (+ 93us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:54.659235 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:54.659285 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:54.659302 (+ 17us) server_negotiation.cc:299] Negotiation successful
0811 00:54:54.659319 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260811 00:54:54.663921 4610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:54.661121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.26.99.190:45607)
0811 00:54:54.661292 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.661294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.661305 (+ 11us) server_negotiation.cc:407] Connection header received
0811 00:54:54.661349 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.661350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.661396 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.661478 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:54.661590 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.662128 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663010 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.663314 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663371 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:54.663594 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:54.663699 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:54.663754 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:54.663800 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 00:54:54.663825 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260811 00:54:54.663991 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:54.661140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53214 (local address 127.26.99.188:42431)
0811 00:54:54.661185 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.661187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.661377 (+ 190us) server_negotiation.cc:407] Connection header received
0811 00:54:54.661417 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.661418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.661437 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.661485 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:54.661665 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.662404 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663292 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.663504 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663561 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:54.663718 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:54.663752 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:54.663795 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:54.663890 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 00:54:54.663914 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:54:54.664103 4580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 00:54:54.661268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.26.99.189:41455)
0811 00:54:54.661307 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 00:54:54.661308 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 00:54:54.661527 (+ 219us) server_negotiation.cc:407] Connection header received
0811 00:54:54.661556 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 00:54:54.661557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 00:54:54.661569 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 00:54:54.661613 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 00:54:54.661736 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.662478 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663337 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 00:54:54.663597 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 00:54:54.663651 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 00:54:54.663789 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 00:54:54.663821 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 00:54:54.663868 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 00:54:54.664014 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 00:54:54.664038 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 00:54:54.665683 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 3956
I20260811 00:54:54.686823 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4089
I20260811 00:54:54.700291 27022 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task7ONN3e/build/release/bin/kudu with pid 4221
2026-08-11T00:54:54Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2970 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5908 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (276987 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST